Testing a decision service using test scenarios
Abstract
Preface
As a business analyst or business rules developer, you can use test scenarios in Business Central to test a decision service before a project is deployed. You can test DMN-based and rules-based decision services to ensure these are functioning properly and as expected. Also, you can test a decision service at any time during project development.
Prerequisites
- The space and project for the decision service have been created in Business Central. For details, see Getting started with decision services.
- Business rules and their associated data objects have been defined for the rules-based decision service. For details, see Designing a decision service using guided decision tables.
- DMN decision logic and its associated custom data types have been defined for the DMN-based decision service. For details, see Designing a decision service using DMN models.
Having defined business rules is not a technical prerequisite for test scenarios, because the scenarios can test the defined data that constitutes the business rules. However, creating the rules first is helpful so that you can also test entire rules in test scenarios and so that the scenarios more closely match the intended decision service. For DMN-based test scenarios ensure that the DMN decision logic and its associated custom data types are defined for the decision service.
Chapter 1. Test scenarios
Test scenarios in Red Hat Decision Manager enable you to validate the functionality of business rules and business rule data (for rules-based test scenarios) or of DMN models (for DMN-based test scenarios) before deploying them into a production environment. With a test scenario, you use data from your project to set given conditions and expected results based on one or more defined business rules. When you run the scenario, the expected results and actual results of the rule instance are compared. If the expected results match the actual results, the test is successful. If the expected results do not match the actual results, then the test fails.
Red Hat Decision Manager currently supports both the new Test Scenarios designer and the former Test Scenarios (Legacy) designer. The default designer is the new test scenarios designer, which supports testing of both rules and DMN models and provides an enhanced overall user experience with test scenarios. If required, you can continue to use the legacy test scenarios designer, which supports rule-based test scenarios only.
You can run the defined test scenarios in a number of ways, for example, you can run available test scenarios at the project level or inside a specific test scenario asset. Test scenarios are independent and cannot affect or modify other test scenarios. You can run test scenarios at any time during project development in Business Central. You do not have to compile or deploy your decision service to run test scenarios.
You can import data objects from different packages to the same project package as the test scenario. Assets in the same package are imported by default. After you create the necessary data objects and the test scenario, you can use the Data Objects tab of the test scenarios designer to verify that all required data objects are listed or to import other existing data objects by adding a New item.
Throughout the test scenarios documentation, all references to test scenarios and the test scenarios designer are for the new version, unless explicitly noted as the legacy version.
Chapter 2. Data objects
Data objects are the building blocks for the rule assets that you create. Data objects are custom data types implemented as Java objects in specified packages of your project. For example, you might create a Person
object with data fields Name
, Address
, and DateOfBirth
to specify personal details for loan application rules. These custom data types determine what data your assets and your decision services are based on.
2.1. Creating data objects
The following procedure is a generic overview of creating data objects. It is not specific to a particular business asset.
Procedure
- In Business Central, go to Menu → Design → Projects and click the project name.
- Click Add Asset → Data Object.
Enter a unique Data Object name and select the Package where you want the data object to be available for other rule assets. Data objects with the same name cannot exist in the same package. In the specified DRL file, you can import a data object from any package.
Importing data objects from other packagesYou can import an existing data object from another package directly into the asset designers like guided rules or guided decision table designers. Select the relevant rule asset within the project and in the asset designer, go to Data Objects → New item to select the object to be imported.
- To make your data object persistable, select the Persistable checkbox. Persistable data objects are able to be stored in a database according to the JPA specification. The default JPA is Hibernate.
- Click Ok.
In the data object designer, click add field to add a field to the object with the attributes Id, Label, and Type. Required attributes are marked with an asterisk (*).
- Id: Enter the unique ID of the field.
- Label: (Optional) Enter a label for the field.
- Type: Enter the data type of the field.
List: (Optional) Select this check box to enable the field to hold multiple items for the specified type.
Figure 2.1. Add data fields to a data object
Click Create to add the new field, or click Create and continue to add the new field and continue adding other fields.
NoteTo edit a field, select the field row and use the general properties on the right side of the screen.
Chapter 3. Test scenarios designer in Business Central
The test scenarios designer provides a tabular layout that helps you in defining a scenario template and all the associated test cases. The designer layout consists of a table which has a header and the individual rows. The header consists of three parts, the GIVEN and EXPECT row, a row with instances, and a row with corresponding fields. The header is also known as test scenario template and the individual rows are called test scenarios definitions.
The test scenario template or header has the following two parts:
- GIVEN data objects and their fields - represents the input information
- EXPECT data objects and their fields - represents the objects and their fields whose exact values are checked based on the given information and which also constitutes the expected result.
The test scenarios definitions represent the separate test cases of a template.
You can access the Project Explorer from the left panel of the designer whereas from the right panel you can access the Settings, Test Tools, Scenario Cheatsheet, Test Report and the Coverage Report tabs. You can access the Settings tab to view and edit the global settings of rule-based and DMN-based test scenarios. You can use the Test Tools to configure the data object mappings. Scenario Cheatsheet tab contains notes and the cheat sheet which you can use as reference. The Test Report tab displays the overview of the tests and the scenario status. To view the test coverage statistics, you can use the Coverage Report tab from the right side of the test scenario designer.
3.1. Importing data objects
The test scenarios designer loads all data objects that are located in the same package as the test scenario. You can view all the data objects from the Data Objects tab in the designer. The loaded data objects are also displayed in the Test Tools panel.
You need to close and reopen the designer in case the data objects change (for example, when a new data object is created or when an existing one is deleted). Select a data object from the list to display its fields and the field types.
In case you want to use a data object located in a different package than the test scenario, you need to import the data object first. Follow the procedure below to import a data object for rules-based test scenarios.
You cannot import any data objects while creating DMN-based test scenarios. DMN-based test scenarios do not use any data objects from the project but uses the custom data types defined in the DMN file.
Procedure
- Go to Project Explorer panel in the test scenarios designer.
- From Test Scenario, select a test scenario.
- Select Data Objects tab and click New Item.
- In the Add import window, choose the data object from the drop-down list.
- Click Ok and then Save.
- Close and reopen the test scenarios designer to view the new data object from the data objects list.
3.2. Importing a test scenario
You can import an existing test scenario using the Import Asset button in the Asset tab from the project view.
Procedure
- In Business Central, go to Menu → Design → Projects and click the project name.
- From the project’s Asset tab, click Import Asset.
In the Create new Import Asset window,
- Enter the name of the import asset.
- Select the package from the Package drop-down list.
- From Please select a file to upload, click Choose File… to browse to test scenario file.
- Select the file and click Open.
- Click Ok and the test scenario opens in the test scenario designer.
3.3. Saving a test scenario
You can save a test scenario at any time while creating a test scenario template or defining the test scenarios.
Procedure
- From the test scenarios designer toolbar on the upper-right, click Save.
On the Confirm Save window,
- If you wish to add a comment regarding the test scenario, click add a comment.
- Click Save again.
A message stating that the test scenario was saved successfully appears on the screen.
3.4. Copying a test scenario
You can copy an existing test scenario to the same package or to some other package by using the Copy button from the upper-right toolbar.
Procedure
- From the test scenarios designer toolbar on the upper-right, click Copy.
In the Make a Copy window,
- Enter a name in the New Name field.
- Select the package you want to copy the test scenario to.
- Optional: To add a comment, click add a comment.
- Click Make a Copy.
A message stating that the test scenario was copied successfully appears on the screen.
3.5. Downloading a test scenario
You can download a copy of the test scenario to your local machine for future reference or as backup.
Procedure
In the test scenarios designer toolbar on the upper-right, click the Download icon.
The .scesim
file is downloaded to your local machine.
3.6. Switching between versions of a test scenario
Business Central provides you the ability to switch between the various versions of a test scenario. Every time you save the scenario, a new version of the scenario is listed under Latest Versions. To use this feature, you must save the test scenario file at least once.
Procedure
- From the test scenarios designer toolbar on the upper-right, click Latest Version. All the versions of the file are listed under Latest Version, if they exist.
Click the version you want to work on.
The selected version of the test scenario opens in the test scenarios designer.
- From the designer toolbar, click Restore.
In the Confirm Restore,
- To add a comment, click add a comment.
- Click Restore to confirm.
A message stating that the selected version has been reloaded successfully in the designer appears on the screen.
3.7. View or hide the alerts panel
The Alerts panel appears at the bottom of the test scenarios designer or the project view. It contains the build information and error messages in case the executed tests are failed.
Procedure
From the designer toolbar on the upper-right, click Hide Alerts/View Alerts to enable or disable the reporting panel.
3.9. Global settings for test scenarios
You can use the global Settings tab on the right side of the test scenarios designer to set and modify the additional properties of assets.
3.9.1. Configuring global settings for rule-based test scenarios
Follow the procedure below to view and edit the global settings of rule-based test scenarios.
Procedure
- Click Settings tab on the right side of the test scenario designer to display the attributes.
Configure the following attributes in the Settings panel:
- Name: You can change the name of the existing test scenarios by using the Rename option from the upper-right toolbar in the designer.
- Type: This attribute specifies it is a rule-based test scenario and it is read-only.
Stateless Session: Select or clear this check box to specify if the KieSession is stateless or not.
NoteIf the current KieSession is stateless and the check box is not selected, the tests will fail.
- KieSession: (Optional) Enter the KieSession for the test scenario.
- RuleFlowGroup/AgendaGroup: (Optional) Enter the RuleFlowGroup or AgendaGroup for the test scenario.
- Optional: To skip the entire simulation from project level after test execution, select the check box.
- Click Save.
3.9.2. Configuring global settings for DMN-based test scenarios
Follow the procedure below to view and edit the global settings of DMN-based test scenarios.
Procedure
- Click Settings tab on the right side of the test scenario designer to display the attributes.
Configure the following attributes in the Settings panel:
- Name: You can change the name of the existing test scenarios by using the Rename option from the upper-right toolbar in the designer.
- Type: This attribute specifies it is a DMN-based test scenario and it is read-only.
- DMN model: (Optional) Enter the DMN model for the test scenario.
- DMN name: This is the name of the DMN model and it is read-only.
- DMN namespace: This is the default namespace for DMN model and it is read-only.
- Optional: To skip the entire simulation from project level after test execution, select the check box.
- Click Save.
Chapter 4. Test scenario template
Before specifying test scenario definitions, you need to create a test scenario template. The header of the test scenario table defines the template for each scenario. You need to set the types of the instance and property headers for both the GIVEN and EXPECT sections. Instance headers map to a particular data object (a fact), whereas the property headers map to a particular field of the corresponding data object.
Using the test scenarios designer, you can create test scenario templates for both rule-based and DMN-based test scenarios.
4.1. Creating a test scenario template for rule-based test scenarios
Create a test scenario template for rule-based test scenarios by following the procedure below to validate your rules and data.
Procedure
- In Business Central, go to Menu → Design → Projects and click the project for which you want to create the test scenario.
- Click Add Asset → Test Scenario.
- Enter a Test Scenario name and select the appropriate Package. The package you select must contain all the required data objects and rule assets have been assigned or will be assigned.
- Select RULE as the Source type.
- Click Ok to create and open the test scenario in the test scenarios designer.
To map the GIVEN column header to a data object:
- Select an instance header cell in the GIVEN section.
- Select the data object from the Test Tools tab.
- Click Insert Data Object.
To map the EXPECT column header to a data object:
- Select an instance header cell in the EXPECT section.
- Select the data object from the Test Tools tab.
- Click Insert Data Object.
To map a data object field to a property cell:
- Select an instance header cell or property header cell.
- Select the data object field from the Test Tools tab.
- Click Insert Data Object.
- To insert more properties of the data object, right-click the property header and select Insert column right or Insert column left as required.
To define a java method to a property cell during test scenarios execution:
- Select an instance header cell or property header cell.
- Select the data object field from the Test Tools tab.
- Click Insert Data Object.
- Use the MVEL expression with the prefix # to define a java method for test scenario execution.
- To insert more properties of the data object, right-click the property header cell and select Insert column right or Insert column left as required.
- Use the contextual menu to add or remove columns and rows as needed.
For more details about the expression syntax in rule-based scenarios, see Section 9.1, “Expression syntax in rule-based test scenarios”.
4.2. Using aliases in rule-based test scenarios
In the test scenarios designer, once you map a header cell with a data object, the data object is removed from the Test Tools tab. You can re-map a data object to another header cell by using an alias. Aliases enable you to specify multiple instances of the same data object in a test scenario. You can also create property aliases to rename the used properties directly in the table.
Procedure
In the test scenarios designer in Business Central, double-click a header cell and manually change the name. Ensure that the aliases are uniquely named.
The instance now appears in the list of data objects in the Test Tools tab.
Chapter 5. Test template for DMN-based test scenarios
Business Central automatically generates the template for every DMN-based test scenario asset and it contains all the specified inputs and decisions of the related DMN model. For each input node in the DMN model, a GIVEN column is added, whereas each decision node is represented by an EXPECT column. You can modify the default template at any time as per your needs. Also, to test only a specific part of the whole DMN model, its possible to remove the generated columns as well as move decision nodes from the EXPECT to the GIVEN section.
5.1. Creating a test scenario template for DMN-based test scenarios
Create a test scenario template for DMN-based scenarios by following the procedure below to validate your DMN models.
Procedure
- In Business Central, go to Menu → Design → Projects and click the project that you want to create the test scenario for.
- Click Add Asset → Test Scenario.
- Enter a Test Scenario name and select the appropriate Package.
- Select DMN as the Source type.
- Select an existing DMN asset using the Choose DMN asset option.
Click Ok to create and open the test scenario in the test scenarios designer.
The template is automatically generated and you can modify it as per your needs.
To define a java method to a property cell during test scenario execution:
- Click an instance header cell or property header cell.
- Select the data object field from the Test Tools tab.
- Click Insert Data Object.
- Use an expression to define a java method for test scenario execution.
- To add more properties to the data object, right-click the property header cell and select Insert column right or Insert column left as required.
- Use the contextual menu to add or remove columns and rows as needed.
For more details about the expression syntax in DMN-based scenarios, see Section 9.2, “Expression syntax in DMN-based scenarios”.
Chapter 6. Defining a test scenario
After creating a test scenario template you have to define the test scenario next. The rows of the test scenario table define the individual test scenarios. A test scenario has a unique index number, description, set of input values (the Given values), and a set of output values (the Expect values).
Prerequisites
- The test scenario template has been created for the selected test scenario.
Procedure
- Open the test scenario in the test scenarios designer.
- Enter a description of the test scenario and fill in required values in each cell of the row.
Use the contextual menu to add or remove rows as required.
Double click a cell to start inline editing. To skip a particular cell from test evaluation, leave it empty.
After defining the test scenario, you can run the test next.
Chapter 7. Background instance in test scenarios
In test scenario designer, you can use the Background tab to add and set the background data for rules-based as well as DMN based test scenarios. You can add and define the GIVEN data which is common for the entire test scenario simulation, based on the available data objects. Background tab has the ability to add and share the data among every test scenario. Data added using the Background tab can not be overridden by Model tab data.
The GIVEN data which is defined in the Background tab can only be shared between the test scenarios of the same *.scesim file and will not be shared among different test scenarios.
7.1. Adding a background data in rule-based test scenarios
Follow the procedure below to add and set a background data in rule-based test scenarios.
Prerequisites
- The rule-based test scenario template are created for the selected test scenario. For more information about creating rule-based test scenarios, see Section 4.1, “Creating a test scenario template for rule-based test scenarios”.
- The individual test scenarios are defined. For more information about defining a test scenario, see Chapter 6, Defining a test scenario.
Procedure
- Open the rule-based test scenarios in the test scenario designer.
- Click the Background tab of the test scenarios designer.
- Select an instance header cell in the GIVEN section to add a background data object field.
- From the Test Tools panel, select the data object.
- Click Insert Data Object.
- Select a property header cell to add a background data object field.
- From the Test Tools panel, select the data object.
- Click Insert Data Object.
- To add more properties to the data object, right-click the property header cell and select Insert column right or Insert column left as required.
- Use the contextual menu to add or remove columns and rows as needed.
- Run the defined test scenarios.
7.2. Adding a background data in DMN based test scenarios
Follow the procedure below to add and set a background data in DMN based test scenarios.
Prerequisites
- The DMN-based test scenario template is created for the selected test scenario. For more information about creating DMN-based test scenarios, see Section 5.1, “Creating a test scenario template for DMN-based test scenarios”.
- The individual test scenarios are defined. For more information about defining a test scenario, see Chapter 6, Defining a test scenario.
Procedure
- Open the rule-based test scenarios in the test scenario designer.
- Click the Background tab of the test scenarios designer.
- Select an instance header cell in the GIVEN section to add a background data object field.
- From the Test Tools panel, select the data object.
- Click Insert Data Object.
- Select a property header cell to add a background data object field.
- From the Test Tools panel, select the data object.
- Click Insert Data Object.
- To add more properties to the data object, right-click the property header cell and select Insert column right or Insert column left as required.
- Use the contextual menu to add or remove columns and rows as needed.
- Run the defined test scenarios.
Chapter 8. Using list and map collections in test scenarios
The test scenarios designer supports list and map collections for both DMN-based as well as rules-based test scenarios. You can define a collection like a list or a map as the value of a particular cell in both GIVEN and EXPECT columns.
For map entries, an entry key must be a String
data type.
Procedure
- Set the column type first (use a field whose type is a list or a map).
- Double click a cell in the column to input a value.
- In the collection editor popup, click Add new item.
- Enter the required value and click the check icon to save each collection item that you add.
Click Save.
To delete an item from the collection, click the bin icon in the collection popup editor. Click Remove to delete the collection itself.
Chapter 9. Expression syntax in test scenarios
The test scenarios designer supports different expression languages for both rule-based and DMN-based test scenarios. While rule-based test scenarios support the MVFLEX Expression Language (MVEL) and DMN-based test scenarios support the Friendly Enough Expression Language (FEEL).
9.1. Expression syntax in rule-based test scenarios
Rule-based test scenario supports the following built-in data types:
- String
- Boolean
- Integer
- Long
- Double
- Float
- Character
- Byte
- Short
- LocalDate
For any other data types, use the MVEL expression with the prefix #
.
Follow the BigDecimal example in the test scenario designer to use the #
prefix to set the java expression:
-
Enter
# java.math.BigDecimal.valueOf(10)
for the GIVEN column value. -
Enter
# actualValue.intValue() == 10
for the EXPECT column value.
You can refer to the actual value of the EXPECT column in the java expression to execute a condition.
The following rule-based test scenario definition expressions are supported by the test scenarios designer:
Operator | Description |
---|---|
= | Specifies equal to a value. This is default for all columns and is the only operator supported by the GIVEN column. |
=, =!, <> | Specifies inequality of a value. This operator can be combined with other operators. |
<, >, <=, >= | Specifies a comparison: less than, greater than, less or equals than, and greater or equals than. |
# | This operator is used to set the java expression value to a property header cell which can be executed as a java method. |
[value1, value2, value3] | Specifies a list of values. If one or more values are valid, the scenario definition is evaluated as true. |
expression1; expression2; expression3 | Specifies a list of expressions. If all expressions are valid, the scenario definition is evaluated as true. |
An empty cell is skipped from evaluation. To define an empty string, use =
,[]
, or ;
. To define a null value, use null
.
Expression | Description |
---|---|
-1 | The actual value is equal to -1. |
< 0 | The actual value is less than 0. |
! > 0 | The actual value is not greater than 0. |
[-1, 0, 1] | The actual value is equal to either -1 or 0 or 1. |
<> [1, -1] | The actual value is neither equal to 1 nor -1. |
! 100; 0 | The actual value is not equal to 100 but is equal to 0. |
!= < 0; <> > 1 | The actual value is neither less than 0 nor greater than 1. |
<> <= 0; >= 1 | The actual value is neither less than 0 nor equal to 0 but is greater than or equal to 1. |
You can refer to the supported commands and syntax in the Scenario Cheatsheet tab on the right of the rule-based test scenarios designer.
9.2. Expression syntax in DMN-based scenarios
The following data types are supported by the DMN-based test scenarios in the test scenarios designer:
Supported data types | Description |
---|---|
numbers & strings |
Strings must be delimited by quotation marks, for example, |
boolean values |
|
dates and time |
For example, |
functions |
Supports built-in math functions, for example, |
contexts |
For example, |
ranges and lists |
For example, |
You can refer to the supported commands and syntax in the Scenario Cheatsheet tab on the right of the DMN-based test scenarios designer.
Chapter 10. Running the test scenarios
After creating a test scenario template and defining the test scenarios, you can run the tests to validate your business rules and data.
Procedure
To run defined test scenarios, do any of the following tasks:
To execute all the available test scenarios in your project inside multiple assets, in the upper-right corner of your project page, click Test.
Run all the test scenarios from the project view
-
To execute all the available test scenarios defined in a single
.scesim
file, at the top of the Test Scenario designer, click the Run Test icon. -
To run a single test scenario defined in a single
.scesim
file, right-click the row of the test scenario you want to run and select Run scenario.
The Test Report panel displays the overview of the tests and the scenario status.
After the tests execute, if the values entered in the test scenario table do not match with the expected values, then the corresponding cells are highlighted.
If tests fail, you can do the following tasks to troubleshoot the failure:
- To review the error message in the pop-up window, hover your mouse cursor over the highlighted cell.
- To open the Alerts panel at the bottom of the designer or the project view for the error messages, click View Alerts.
- Make the necessary changes and run the test again until the scenario passes.
Chapter 11. Running a test scenario locally
In Red Hat Decision Manager, you can either run the test scenarios directly in Business Central or locally using the command line.
Procedure
- In Business Central, go to Menu → Design → Projects and click the project name.
- On the Project’s home page, select the Settings tab.
- Select git URL and click the Clipboard to copy the git url.
- Open a command terminal and navigate to the directory where you want to clone the git project.
Run the following command:
git clone your_git_project_url
Replace
your_git_project_url
with relevant data likegit://localhost:9418/MySpace/ProjectTestScenarios
.Once the project is successfully cloned, navigate to the git project directory and execute the following command:
mvn clean test
Your project’s build information and the test results (such as, the number of tests run and whether the test run was a success or not) are displayed in the command terminal. In case of failures, make the necessary changes in Business Central, pull the changes and run the command again.
Chapter 12. Exporting and importing test scenario spreadsheets
These sections show how to export and import test scenario spreadsheets in the test scenario designer. You can analyze and manage test scenario spreadsheets with software such as Microsoft Excel or LibreOffice Calc. Test scenario designer supports the .CSV
file format. For more information about the RFC specification for the Comma-Separated Values (CSV) format, see Common Format and MIME Type for Comma-Separated Values (CSV) Files.
12.1. Exporting a test scenario spreadsheet
Follow the procedure below to export a test scenario spreadsheet using the Test Scenario designer.
Procedure
- In the Test Scenario designer toolbar on the upper-right, click Export button.
-
Select a destination in your local file directory and confirm to save the
.CSV
file.
The .CSV
file is exported to your local machine.
12.2. Importing a test scenario spreadsheet
Follow the procedure below to import a test scenario spreadsheet using the Test Scenario designer.
Procedure
- In the Test Scenario designer toolbar on the upper-right, click Import button.
-
In the Select file to Import prompt, click Choose File… and select the
.CSV
file you would like to import from your local file directory. - Click Import.
The .CSV
file is imported to the Test Scenario designer.
You must not modify the headers in the selected .CSV
file. Otherwise, the spreadsheet may not be successfully imported.
Chapter 13. Coverage reports for test scenarios
The test scenario designer provides a clear and coherent way of displaying the test coverage statistics using the Coverage Report tab on the right side of the test scenario designer. You can also download the coverage report to view and analyze the test coverage statistics. Downloaded test scenario coverage report supports the .CSV
file format. For more information about the RFC specification for the Comma-Separated Values (CSV) format, see Common Format and MIME Type for Comma-Separated Values (CSV) Files.
You can view the coverage report for rule-based and DMN-based test scenarios.
13.1. Generating coverage reports for rule-based test scenarios
In rule-based test scenarios, the Coverage Report tab contains the detailed information about the following:
- Number of available rules
- Number of fired rules
- Percentage of fired rules
- Percentage of executed rules represented as a pie chart
- Number of times each rule has executed
- The rules that are executed for each defined test scenario
Follow the procedure to generate a coverage report for rule-based test scenarios:
Prerequisites
- The rule-based test scenario template are created for the selected test scenario. For more information about creating rule-based test scenarios, see Section 4.1, “Creating a test scenario template for rule-based test scenarios”.
The individual test scenarios are defined. For more information about defining a test scenario, see Chapter 6, Defining a test scenario.
NoteTo generate the coverage report for rule-based test scenario, you must create at least one rule.
Procedure
- Open the rule-based test scenarios in the test scenario designer.
- Run the defined test scenarios.
- Click Coverage Report on the right of the test scenario designer to display the test coverage statistics.
- Optional: To download the test scenario coverage report, Click Download report.
13.2. Generating coverage reports for DMN-based test scenarios
In DMN-based test scenarios, the Coverage Report tab contains the detailed information about the following:
- Number of available decisions
- Number of executed decisions
- Percentage of executed decisions
- Percentage of executed decisions represented as a pie chart
- Number of times each decision has executed
- Decisions that are executed for each defined test scenario
Follow the procedure to generate a coverage report for DMN-based test scenarios:
Prerequisites
- The DMN-based test scenario template is created for the selected test scenario. For more information about creating DMN-based test scenarios, see Section 5.1, “Creating a test scenario template for DMN-based test scenarios”.
- The individual test scenarios are defined. For more information about defining a test scenario, see Chapter 6, Defining a test scenario.
Procedure
- Open the DMN-based test scenarios in the test scenario designer.
- Run the defined test scenarios.
- Click Coverage Report on the right of the test scenario designer to display the test coverage statistics.
- Optional: To download the test scenario coverage report, Click Download report.
Chapter 14. Creating test scenario using the sample Mortgages project
This chapter illustrates creating and executing a test scenario from the sample Mortgages project shipped with Business Central using the test scenario designer. The test scenario example in this chapter is based on the Pricing loans guided decision table from the Mortgages project.
Procedure
- In Business Central, go to Menu → Design → Projects and click Mortgages.
If the project is not listed under Projects, from MySpace, click Try Samples → Mortgages → OK.
The Assets window appears.
- Click Add Asset → Test Scenario.
Enter
scenario_pricing_loans
as the Test Scenario name and select the defaultmortgages.mortgages
package from the Package drop-down list.The package you select must contain all the required rule assets.
- Select RULE as the Source type.
- Click Ok to create and open the test scenario in the test scenario designer.
Expand Project Explorer and verify the following:
-
Applicant
,Bankruptcy
,IncomeSource
, andLoanApplication
data objects exist. -
Pricing loans
guided decision table exists. - Verify that the new test scenario is listed under Test Scenario
-
After verifying that everything is in place, return to the Model tab of the test scenario designer and define the GIVEN and EXPECT data for the scenario, based on the available data objects.
A blank test scenario designer
Define the GIVEN column details:
- Click the cell named INSTANCE 1 under the GIVEN column header.
- From the Test Tools panel, select the LoanApplication data object.
- Click Insert Data Object.
- To create properties for the data object, right-click the property header cell and select Insert column right or Insert column left as required. For this example, you need to create two more property cells under the GIVEN column.
Select the first property header cell:
- From the Test Tools panel, select and expand the LoanApplication data object.
- Click amount.
- Click Insert Data Object to map the data object field to the property header cell.
Select the second property header cell:
- From the Test Tools panel, select and expand the LoanApplication data object.
- Click deposit.
- Click Insert Data Object.
Select the third property header cell:
- From the Test Tools panel, select and expand the LoanApplication data object.
- Click lengthYears
- Click Insert Data Object.
- Right-click the LoanApplication header cell and select Insert column right. A new GIVEN column to the right is created.
Select the new header cell:
- From the Test Tools panel, select the IncomeSource data object.
- Click Insert Data Object to map the data object to the header cell.
Select the property header cell below IncomeSource:
- From the Test Tools panel, select and expand the IncomeSource data object.
- Click type.
Click Insert Data Object to map the data object field to the property header cell.
You have now defined all the GIVEN column cells.
Next, define the EXPECT column details:
- Click the cell named INSTANCE 2 under the EXPECT column header.
- From the Test Tools panel, select LoanApplication data object.
- Click Insert Data Object.
- To create properties for the data object, right-click the property header cell and select Insert column right or Insert column left as required. Create two more property cells under the EXPECT column.
Select the first property header cell:
- From the Test Tools panel, select and expand the LoanApplication data object.
- Click approved.
- Click Insert Data Object to map the data object field to the property header cell.
Select the second property header cell:
- From the Test Tools panel, select and expand the LoanApplication data object.
- Click insuranceCost.
- Click Insert Data Object to map the data object field to the property header cell.
Select the third property header cell:
- From the Test Tools panel, select and expand the LoanApplication data object.
- Click approvedRate.
- Click Insert Data Object to map the data object field to the property header cell.
To define the test scenario, enter the following data in the first row:
-
Enter
Row 1 test scenario
as the Scenario Description,150000
as the amount,19000
as the deposit,30
as the lengthYears, andAsset
as the type for the GIVEN column values. -
Enter
true
as approved,0
as the insuranceCost and2
as the approvedRate for the EXPECT column values.
-
Enter
Next enter the following data in the second row:
-
Enter
Row 2 test scenario
as the Scenario Description,100002
as the amount,2999
as the deposit,20
as the lengthYears, andJob
as the type for the GIVEN column values. -
Enter
true
as approved,10
as the insuranceCost and6
as the approvedRate for the EXPECT column values.
-
Enter
- After you have defined all GIVEN, EXPECT, and other data for the scenario, click Save in the test scenario designer to save your work.
Click Run Test in the upper-right corner to run the
.scesim
file.The test result is displayed in the Test Report panel. Click View Alerts to display messages from the Alerts section. If a test fails, refer to the messages in the Alerts section at the bottom of the window, review and correct all components in the scenario, and try again to validate the scenario until the scenario passes.
- Click Save in the test scenario designer to save your work after you have made all necessary changes.
Chapter 15. Test scenarios (legacy) designer in Business Central
Red Hat Decision Manager currently supports both the new Test Scenarios designer and the former Test Scenarios (Legacy) designer. The default designer is the new test scenarios designer, which supports testing of both rules and DMN models and provides an enhanced overall user experience with test scenarios. If required, you can continue to use the legacy test scenarios designer, which supports rule-based test scenarios only.
15.1. Creating and running a test scenario (legacy)
You can create test scenarios in Business Central to test the functionality of business rule data before deployment. A basic test scenario must have at least the following data:
- Related data objects
- GIVEN facts
- EXPECT results
The legacy test scenarios designer supports the LocalDate
java built-in data type. You can use the LocalDate
java built-in data type in the dd-mmm-yyyy
date format. For example, you can set this in the 17-Oct-2020
date format.
With this data, the test scenario can validate the expected and actual results for that rule instance based on the defined facts. You can also add a CALL METHOD and any available globals to a test scenario, but these scenario settings are optional.
Procedure
- In Business Central, go to Menu → Design → Projects and click the project name.
- Click Add Asset → Test Scenarios (Legacy).
- Enter an informative Test Scenario name and select the appropriate Package. The package that you specify must be the same package where the required rule assets have been assigned or will be assigned. You can import data objects from any package into the asset’s designer.
Click Ok to create the test scenario.
The new test scenario is now listed in the Test Scenarios panel of the Project Explorer,
- Click the Data Objects tab to verify that all data objects required for the rules that you want to test are listed. If not, click New item to import the needed data objects from other packages, or create data objects within your package.
After all data objects are in place, return to the Model tab of the test scenarios designer and define the GIVEN and EXPECT data for the scenario, based on the available data objects.
Figure 15.1. The test scenarios designer
The GIVEN section defines the input facts for the test. For example, if an
Underage
rule in the project declines loan applications for applicants under the age of 21, then the GIVEN facts in the test scenario could beApplicant
withage
set to some integer less than 21.The EXPECT section defines the expected results based on the GIVEN input facts. That is, GIVEN the input facts, EXPECT these other facts to be valid or entire rules to be activated. For example, with the given facts of an applicant under the age of 21 in the scenario, the EXPECT results could be
LoanApplication
withapproved
set tofalse
(as a result of the underage applicant), or could be the activation of theUnderage
rule as a whole.Optionally, add a CALL METHOD and any globals to the test scenario:
- CALL METHOD: Use this to invoke a method from another fact when the rule execution is initiated. Click CALL METHOD, select a fact, and click to select the method to invoke. You can invoke any Java class methods (such as methods from an ArrayList) from the Java library or from a JAR that was imported for the project (if applicable).
- globals: Use this to add any global variables in the project that you want to validate in the test scenario. Click globals to select the variable to be validated, and then in the test scenarios designer, click the global name and define field values to be applied to the global variable. If no global variables are available, then they must be created as new assets in Business Central. Global variables are named objects that are visible to the decision engine but are different from the objects for facts. Changes in the object of a global do not trigger the re-evaluation of rules.
- Click More at the bottom of the test scenarios designer to add other data blocks to the same scenario file as needed.
- After you have defined all GIVEN, EXPECT, and other data for the scenario, click Save in the test scenarios designer to save your work.
Click Run scenario in the upper-right corner to run this
.scenario
file, or click Run all scenarios to run all saved.scenario
files in the project package (if there are multiple). Although the Run scenario option does not require the individual.scenario
file to be saved, the Run all scenarios option does require all.scenario
files to be saved.If the test fails, address any problems described in the Alerts message at the bottom of the window, review all components in the scenario, and try again to validate the scenario until the scenario passes.
- Click Save in the test scenarios designer to save your work after all changes are complete.
15.1.1. Adding GIVEN facts in test scenarios (legacy)
The GIVEN section defines input facts for the test. For example, if an Underage
rule in the project declines loan applications for applicants under the age of 21, then the GIVEN facts in the test scenario could be Applicant
with age
set to some integer less than 21.
Prerequisites
- All data objects required for your test scenario have been created or imported and are listed in the Data Objects tab of the Test Scenarios (Legacy) designer.
Procedure
In the Test Scenarios (Legacy) designer, click GIVEN to open the New input window with the available facts.
Figure 15.2. Add GIVEN input to the test scenario
The list includes the following options, depending on the data objects available in the Data Objects tab of the test scenarios designer:
- Insert a new fact: Use this to add a fact and modify its field values. Enter a variable for the fact as the Fact name.
- Modify an existing fact: (Appears only after another fact has been added.) Use this to specify a previously inserted fact to be modified in the decision engine between executions of the scenario.
- Delete an existing fact: (Appears only after another fact has been added.) Use this to specify a previously inserted fact to be deleted from the decision engine between executions of the scenario.
- Activate rule flow group: Use this to specify a rule flow group to be activated so that all rules within that group can be tested.
-
Choose a fact for the desired input option and click Add. For example, set Insert a new fact: to Applicant and enter
a
orapp
or any other variable for the Fact name. Click the fact in the test scenarios designer and select the field to be modified.
Figure 15.3. Modify a fact field
Click the edit icon ( ) and select from the following field values:
- Literal value: Creates an open field in which you enter a specific literal value.
- Bound variable: Sets the value of the field to the fact bound to a selected variable. The field type must match the bound variable type.
- Create new fact: Enables you to create a new fact and assign it as a field value of the parent fact. Then you can click the child fact in the test scenarios designer and likewise assign field values or nest other facts similarly.
- Continue adding any other GIVEN input data for the scenario and click Save in the test scenarios designer to save your work.
15.1.2. Adding EXPECT results in test scenarios (legacy)
The EXPECT section defines the expected results based on the GIVEN input facts. That is, GIVEN the input facts, EXPECT other specified facts to be valid or entire rules to be activated. For example, with the given facts of an applicant under the age of 21 in the scenario, the EXPECT results could be LoanApplication
with approved
set to false
(as a result of the underage applicant), or could be the activation of the Underage
rule as a whole.
Prerequisites
- All data objects required for your test scenario have been created or imported and are listed in the Data Objects tab of the Test Scenarios (Legacy) designer.
Procedure
In the Test Scenarios (Legacy) designer, click EXPECT to open the New expectation window with the available facts.
Figure 15.4. Add EXPECT results to the test scenario
The list includes the following options, depending on the data in the GIVEN section and the data objects available in the Data Objects tab of the test scenarios designer:
- Rule: Use this to specify a particular rule in the project that is expected to be activated as a result of the GIVEN input. Type the name of a rule that is expected to be activated or select it from the list of rules, and then in the test scenarios designer, specify the number of times the rule should be activated.
- Fact value: Use this to select a fact and define values for it that are expected to be valid as a result of the facts defined in the GIVEN section. The facts are listed by the Fact name previously defined for the GIVEN input.
- Any fact that matches: Use this to validate that at least one fact with the specified values exists as a result of the GIVEN input.
-
Choose a fact for the desired expectation (such as Fact value:
application
) and click Add or OK. Click the fact in the test scenarios designer and select the field to be added and modified.
Figure 15.5. Modify a fact field
Set the field values to what is expected to be valid as a result of the GIVEN input (such as
approved
|equals
|false
).NoteIn the legacy test scenarios designer, you can use
=["value1", "value2"]
string format in the EXPECT field to validate the list of strings.- Continue adding any other EXPECT input data for the scenario and click Save in the test scenarios designer to save your work.
After you have defined and saved all GIVEN, EXPECT, and other data for the scenario, click Run scenario in the upper-right corner to run this
.scenario
file, or click Run all scenarios to run all saved.scenario
files in the project package (if there are multiple). Although the Run scenario option does not require the individual.scenario
file to be saved, the Run all scenarios option does require all.scenario
files to be saved.If the test fails, address any problems described in the Alerts message at the bottom of the window, review all components in the scenario, and try again to validate the scenario until the scenario passes.
- Click Save in the test scenarios designer to save your work after all changes are complete.
Chapter 16. Next steps
Appendix A. Versioning information
Documentation last updated on Friday, May 22, 2020.