Compare test case results with expected results

To compare the test case results with the expected results you need to run the test scripts for a rulebase. A report will the be generated which shows the results.

What do you want to do?

Run a single test script

Run multiple test scripts

View the test results

Customize the test report

Run a single test script

To run a single test script:

  1. Ensure that you have created your test case/s and outcome set.
  2. Click the Execute button on your test script tab. NOTE: This will just run the currently active test script.
    The test script will run and the Tester Report will be displayed in a new Results tab.

Run multiple test scripts

To run multiple scripts for a rulebase:

  1. In Oracle Policy Modeling, select Reports | Run Multiple Test Scripts...
    The Run Test Scripts dialog box will open.
  2. Select the scripts in your rulebase that you would like to run. (If you do not want the reports from your test scripts combined, clear the Combine all test scripts into one report check box.) Click OK.
    The selected test scripts will run and a Tester Report will be displayed for each test script.

 

You should re-run your test script/s whenever the rulebase changes to guarantee that the results are still correct.

View the test results

After a test script has run a Results tab will open in the top right hand pane in Oracle Policy Modeling which shows the Tester Report.

An example of a Tester Report is shown below. The report contains two sections: a summary of the report and the test case comparison results. There will also be an additional section for Errors if any are encountered during the running of the script.

Test cases that pass are highlighted in green and test cases that fail are highlighted in red.

 

 

You can save this report by clicking the Save button on this tab. This saves the report as a HTML file.

Customize the test report

Reports can be customized by changing the report options in File | Project Properties... | Regression Tester Properties | Report Options.

 

 

 

The options in this dialog box are explained below:

Setting Options
Report type

The Test Report can be rendered in two distinct layouts – sequential or tabular.

  • the sequential layout lists results for cases down the page
  • the tabular layout presents results in a grid (cases rows and attribute columns)

Alternatively, you can specify a custom XSLT template for the regression tester to use when generating the Test Report.

Report heading styles

There are three options for report headings:

  • Outcome ID only - this will cause reports to display with attribute IDs (either model ID or public name) as headings.
  • Outcome display text only - this will cause reports to display with the value of the Display Text specified for the attribute in the outcome set.
  • Both outcome ID and display text - will display both the attribute IDs and the Display Text.
Omit from report

You have the option to omit from the Test Report:

  • Values that match - this excludes attributes with outcome values that match the test case, and/or
  • Test cases that pass - this excludes test cases that have passed.