Chapter 3. Using the Test Scenario designer in Business Central
Red Hat Decision Manager ships with two designers for you to create and run test scenarios to validate your business rules and data. The difference between them is that by using the Test Scenario designer you can create and run both DMN-based test scenarios as well as rules-based test scenarios whereas by using the Test Scenario (Legacy) designer you can create and run only rules-based test scenarios. Both are supported by Red Hat for production use. The sections covered in this chapter will help you understand how to use the Test Scenario designer to create and run test scenarios.
Currently, the Test Scenario designer can only use the default KIE session.
3.1. Test Scenario designer
Red Hat Decision Manager now comes with a new Test Scenario designer that fully supports DMN model testing. This designer provides a new and enhanced user experience when you test or validate DMN-based test scenarios. The aim of the new designer is to help the user test the proper functioning of the created rules and knowledge bases.
3.1.1. Test Scenario designer layout
The designer introduces a tabular layout which helps you in defining a scenario template and all the associated test cases. The designer layout consists of a table which has a header and the individual rows. The header consists of three parts, the GIVEN and EXPECT row, a row with instances, and a row with corresponding fields. The header is also known as test scenario template and the individual rows are called test scenarios definitions.
The test scenario template or header has the following two parts:
- GIVEN data objects and their fields - represents the input information
- EXPECT data objects and their fields - represents the objects and their fields whose exact values are checked based on the given information and which also constitutes the expected result.
The test scenarios definitions represent the separate test cases of a template.
You can access the Project Explorer from the left panel of the designer whereas from the right panel you can access the Test Tools and the Test Report. You can use the Test Tools from the right panel to configure the data object mappings (Test Editor) or for accessing the cheat sheet (Scenario Cheatsheet) that contain notes which you can use as reference.
3.1.2. Importing data objects
Test Scenario designer loads all data objects that are located in the same package as the test scenario. You can view all the data objects from the Data Objects tab in the designer. The loaded data objects are also displayed in the Test Editor tab in the Test Tools panel.
You need to close and reopen the designer in case the data objects change (for example, when a new data object is created or when an existing one is deleted). Select a data object from the list to display its fields and the field types.
In case you want to use a data object located in a different package than the test scenario, you need to import the data object first. Follow the procedure below to import a data object for rules-based test scenarios.
You cannot import any data objects while creating DMN-based test scenarios. DMN-based test scenarios does not use any data objects from the project but uses the custom data types defined in the DMN file.
Procedure
- Go to Project Explorer panel in the Test Scenario designer.
- From Test Scenario, select a test scenario.
- Select Data Objects tab and click New Item.
- In the Add import window, choose the data object from the drop-down list.
- Click Ok and then Save.
- Close and reopen the Test Scenario designer to view the new data object from the data objects list.
3.1.3. Importing a test scenario
You can import an existing test scenario using the Import Asset button in the Asset tab from the project view.
Procedure
-
In Business Central, go to Menu
Design Projects and click the project name. - From the project’s Asset tab, click Import Asset.
In the Create new Import Asset window,
- Enter the name of the import asset.
- Select the package from the Package drop-down list.
- From Please select a file to upload, click Choose File… to browse to test scenario file.
- Select the file and click Open.
- Click Ok and the test scenario opens in the review designer.
3.2. Basic operations using the Test Scenario designer
You can perform the following operations using the Test Scenario designer:
- Save a test scenario
- Delete a test scenario
- Rename a test scenario
- Copy a test scenario
- Run a test scenario
- Download a test scenario
- Switch between different versions of a test scenario
- View or Hide Alerts
3.2.1. Saving a test scenario
You can save a test scenario at any time while creating a test scenario template or defining the test scenarios.
Procedure
- From the Test Scenario designer toolbar on the upper-right, click Save.
On the Confirm Save window,
- If you wish to add a comment regarding the test scenario, click add a comment.
- Click Save again.
A message stating that the test scenario was saved successfully appears on the screen.
3.2.2. Deleting a test scenario
You can delete existing test scenarios that were created using the Test Scenario designer.
Procedure
- From the Test Scenario designer toolbar on the upper-right, click Delete.
In the Confirm Delete window,
- To add a comment regarding the deletion of the test scenario, click add a comment.
- Click Delete.
A message stating that the test scenario was deleted successfully appears on the screen.
3.2.3. Renaming a test scenario
You can rename existing test scenarios by using the Rename button from the upper-right toolbar in the designer.
Procedure
- From the Test Scenario designer toolbar on the upper-right, click Rename.
In the Rename Asset window,
- Enter a name in the Asset Name field.
- If you wish to add a comment, click add a comment.
Click Rename.
NoteClicking on Rename simply renames the test scenario file.
- From the Test Scenario designer toolbar on the upper-right, click Save.
In the Confirm Save window,
- If you wish to add a comment, click add a comment.
- Click Save again.
- Alternately, you could click Save and Rename to save and rename the scenario at the same time.
A message stating that the test scenario was renamed successfully appears on the screen.
3.2.4. Copying a test scenario
You can copy an existing test scenario to the same package or to some other package by using the Copy button from the upper-right toolbar.
Procedure
- From the Test Scenario designer toolbar on the upper-right, click Copy.
In the Make a Copy window,
- Enter a name in the New Name field.
- Select the package you want to copy the test scenario to.
- Optionally, to add a comment, click add a comment.
- Click Make a Copy.
A message stating that the test scenario was copied successfully appears on the screen.
3.2.5. Downloading a test scenario
You can download a copy of the test scenario to your local machine for future reference or as backup.
Procedure
- From the Test Scenario designer toolbar on the upper-right, click Download.
The .scesim file is downloaded to your local machine.
3.2.6. Switching between versions of a test scenario
Business Central provides you the ability to switch between the various versions of a test scenario. Every time you save the scenario, a new version of the scenario is listed under Latest Versions. To use this feature, you must save the test scenario file at least once.
Procedure
- From the Test Scenario designer toolbar on the upper-right, click Latest Version. All the versions of the file are listed under Latest Version, if they exist.
Click the version you want to work on.
The selected version of the test scenario opens in the Test Scenario designer.
- From the designer toolbar, click Restore.
In the Confirm Restore,
- To add a comment, click add a comment.
- Click Restore to confirm.
A message stating that the selected version has been reloaded successfully in the designer appears on the screen.
3.2.7. View/hide the alerts panel
In the Test Scenario designer, the message panel appears at the bottom of the designer with the test results and the Alert messages. From the designer’s toolbar on the upper-right, click Hide Alerts/View Alerts to enable or disable the reporting panel.
3.4. Test scenario template
Before specifying test scenario definitions, you need to create a test scenario template. The header of the test scenario table defines the template for each scenario. You need to set the types of the instance and property headers for both the GIVEN and EXPECT sections. Instance headers map to a particular data object (a fact), whereas the property headers map to a particular field of the corresponding data object.
Using the Test Scenario designer, you can create test scenario templates for both rule-based scenarios as well as DMN-based scenarios.
3.4.1. Creating a test scenario template for rule-based test scenarios
Create a test scenario template for rule-based scenarios by following the procedure below to validate your rules and data.
Procedure
-
In Business Central, go to Menu
Design Projects and click the project for which you want to create the test scenario. -
Click Add Asset
Test Scenario. - Enter a Test Scenario name and select the appropriate Package. The package you select must contain all the required data objects and rule assets have been assigned or will be assigned.
- Select RULE as the Source type.
- Click Ok to create and open the test scenario in the Test Scenario designer.
To map the GIVEN column header to a data object,
- Click an instance header in the GIVEN section.
- Select the data object from the Test Editor tab.
- Click Add.
- To insert more properties of the data object, right-click the property header and select Insert column right or Insert column left as required.
To map a data object field to a property cell,
- Click a property cell.
- Select the data object field from the Test Editor tab.
- Click Add.
To map the EXPECT column header to a data object,
- Click an instance header in the EXPECT section.
- Select the data object from the Test Editor tab.
- Click Add.
- To insert more properties of the data object, right-click the property header and select Insert column right or Insert column left as required.
To map a data object field to a property cell,
- Click a property cell.
- Select the data object field from the Test Editor tab.
- Click Add.
Use the contextual menu to add or remove columns as needed.
After you have created and mapped both the GIVEN & EXPECT columns to a data object & its properties, you have to define the test scenario which comes next.
3.4.2. Concept of aliases (for rule-based scenarios only)
In the Test Scenario designer, once you map a header cell with a data object, the data object is removed from the Test Editor tab in the Test Tools panel. You can re-map a data object to another header cell by using the concept of Alias. Aliases enable you to specify multiple instances of the same data object. Ensure that the aliases are uniquely named. By doing so, the data object again becomes available in the Test Editor tab for remapping. To introduce an alias, double click on a corresponding header cell and manually change the name. You can create property aliases as well. This allows you to rename the used properties directly in the table.
3.5. Test template for DMN-based test scenarios
Business Central automatically generates the template for every DMN-based test scenario asset and it contains all the specified inputs and decisions of the related DMN model. For each input node in the DMN model, a GIVEN column is added, whereas each decision node is represented by an EXPECT column. You can modify the default template at any time as per your needs. Also, to test only a specific part of the whole DMN model, its possible to remove the generated columns as well as move decision nodes from the EXPECT to the GIVEN section.
3.5.1. Creating a test scenario template for DMN-based test scenarios
Create a test scenario template for DMN-based scenarios by following the procedure below to validate your DMN models.
Procedure
-
In Business Central, go to Menu
Design Projects and click the project that you want to create the test scenario for. -
Click Add Asset
Test Scenario. - Enter a Test Scenario name and select the appropriate Package.
- Select DMN as the Source type.
- Select an existing DMN asset using the Choose DMN asset option.
- Click Ok to create and open the test scenario in the Test Scenario designer.
The template is automatically generated and you can modify it as per your needs.
3.6. Defining a test scenario
After creating a test scenario template you have to define the test scenario next. The rows of the test scenario table define the individual test scenarios. A test scenario has a unique index number, description, set of input values (the Given values), and a set of output values (the Expect values).
Prerequisite
Ensure that the test scenario template exists for the selected test scenario.
Procedure
- Open the test scenario in the Test Scenario designer.
- Enter a description of the test scenario and fill in required values in each cell of the row.
Use the contextual menu to add or remove rows as required.
Double click a cell to start inline editing. To skip a particular cell from test evaluation, leave it empty.
After defining the test scenario, you can run the test next.
3.7. List and map collections in Test Scenario designer
Test Scenario designer supports list and map collections for both DMN-based as well as rules-based test scenarios. You can define a collection like a list or a map as the value of a particular cell in both GIVEN and EXPECT columns.
Procedure
- Set the column type first (use a field whose type is a list or a map).
- Double click a cell in the column to input a value.
- In the collection editor popup, click Add new item.
- Enter the required value and click the check icon to save each collection item that you add.
Click Save.
To delete an item from the collection, click the bin icon in the collection popup editor. Click Remove to delete the collection itself.
3.8. Expressions syntax
The test scenario designer supports different expression languages for both rule-based and DMN-based test scenarios. While rule-based test scenarios support a basic expression language, DMN-based test scenarios support the FEEL expression language.
3.8.1. Expression syntax in rule-based scenarios
The following rule-based test scenario definition expressions are supported by Test Scenario designer:
Operator | Description |
---|---|
= | Specifies equal to a value. This is default for all columns and is the only operator supported by the GIVEN column. |
=, =!, <> | Specifies inequality of a value. This operator can be combined with other operators. |
<, >, <=, >= | Specifies a comparison: less than, greater than, less or equals than, and greater or equals than. |
[value1, value2, value3] | Specifies a list of values. If one or more values are valid, the scenario definition is evaluated as true. |
expression1; expression2; expression3 | Specifies a list of expressions. If all expressions are valid, the scenario definition is evaluated as true. |
An empty cell is skipped from evaluation. To define an empty string, use =
,[]
, or ;
. To define a null value, use null
.
Expression | Description |
---|---|
-1 | The actual value is equal to -1. |
< 0 | The actual value is less than 0. |
! > 0 | The actual value is not greater than 0. |
[-1, 0, 1] | The actual value is equal to either -1 or 0 or 1. |
<> [1, -1] | The actual value is neither equal to 1 nor -1. |
! 100; 0 | The actual value is not equal to 100 but is equal to 0. |
!= < 0; <> > 1 | The actual value is neither less than 0 nor greater than 1. |
<> <= 0; >= 1 | The actual value is neither less than 0 nor equal to 0 but is greater than or equal to 1. |
You can refer to the supported commands and syntax in the Scenario Cheatsheet tab on the Test Tools panel on the right of the Test Scenario designer.
3.8.2. Expression syntax in DMN-based scenarios
The following data types are supported by the DMN-based test scenarios in the Test Scenario designer:
Supported data types | Description |
---|---|
numbers & strings |
Strings must be delimited by quotation marks, for example, |
boolean values |
|
dates and time |
For example, |
functions | |
contexts |
For example, |
ranges and lists |
For example, |
You can refer to the supported commands and syntax in the Scenario Cheatsheet tab on the Test Tools panel on the right side of the Test Scenario designer.
3.9. Running a test scenario
After creating a test scenario template and defining the test scenarios, you can run the tests to validate your business rules and data.
Procedure
- At the top of the Test Scenario designer, click Run Test icon.
- The Test Report panel pops out from the right of the designer and displays the test result overview and the scenario status.
- After the tests are executed, click View Alerts to open the Alerts panel at the bottom of the designer for the error messages.
In case the tests fails, review the error messages. Messages with a red cross indicate test failures where as those with a green check mark indicate successful tests.
In the designer, erroneous rows or cells are highlighted in red.
- Make the necessary changes and run the test again till the scenario passes.
3.10. Running a test scenario locally
In Red Hat Decision Manager, you can run tests in two ways. One way is click the Run Test icon at the top of the Test Scenarios designer. The other way is to run the tests locally using the command line.
Procedure
-
In Business Central, go to Menu
Design Projects and click the project name. - On the Project’s home page, select the Settings tab.
- Select git URL and click the Clipboard to copy the git url.
- Open a command terminal and navigate to the directory where you want to clone the git project.
From your project’s directory run the following command:
git clone your_git_project_url
Replace
your_git_project_url
with relevant data likegit://localhost:9418/MySpace/ProjectTestScenarios
.Once the project is successfully cloned, navigate to the git project directory and execute the following command:
mvn clean test
Your project’s build information and the test results (such as, the number of tests run and whether the test run was a success or not) are displayed in the command terminal. In case of errors, correct them and run the command again.
3.11. Creating test scenario using the sample Mortgages project
This chapter illustrates creating and executing a test scenario from the sample Mortgages project shipped with Business Central using the Test Scenario designer. The test scenario example in this chapter is based on the Pricing loans guided decision table from the Mortgages project.
Procedure
-
In Business Central, go to Menu
Design Projects and click Mortgages. - If the project is not listed under Projects, from MySpace, click the three dots ( ) in the upper-right corner of the page.
Click Try Samples
Mortgages OK. The Assets window appears.
-
Click Add Asset
Test Scenario. Enter
scenario_pricing_loans
as the Test Scenario name and select the defaultmortgages.mortgages
package from the Package drop-down list.The package you select must contain all the required rule assets.
- Click Ok to create and open the test scenario in the Test Scenario designer.
Expand Project Explorer and verify the following:
-
Applicant
,Bankruptcy
,IncomeSource
, andLoanApplication
data objects exist. -
Pricing loans
guide decision table exists. - Verify that the new test scenario is listed under Test Scenario
-
After verifying that everything is in place, return to the Model tab of the test scenarios designer and define the GIVEN and EXPECT data for the scenario, based on the available data objects.
Figure 3.1. A blank Test Scenario designer
Define the GIVEN column details,
- Click the cell named INSTANCE 1 under the GIVEN column header.
-
From Test Tools
Test Editor, select LoanApplication data object. - Click Add.
- To create properties of the data object, right-click the property cell and select Insert column right or Insert column left as required. For this example, you need to create two more property cells under the GIVEN column.
Click the first property cell,
-
From Test Tools
Test Editor, select and expand the LoanApplication data object. - Click amount and then Add to map the data object field to the property cell.
-
From Test Tools
Click the second property cell,
-
From Test Tools
Test Editor, select and expand the LoanApplication data object. - Click deposit and then Add.
-
From Test Tools
Click the third property cell,
-
From Test Tools
Test Editor, select and expand the LoanApplication data object. - Click lengthYears and then Add.
-
From Test Tools
- Right-click LoanApplication header cell and select Insert column right. A new GIVEN column to the right is created.
Click the new header cell,
-
From Test Tools
Test Editor, select the IncomeSource data object. - Click Add to map the data object to the header cell.
-
From Test Tools
Click the property cell below IncomeSource,
-
From Test Tools
Test Editor, select and expand the IncomeSource data object. Click type and then Add to map the data object field to the property cell.
You have now defined all the GIVEN column cells.
-
From Test Tools
Next, define the EXPECT column details,
- Click the cell named INSTANCE 2 under the EXPECT column header.
-
From Test Tools
Test Editor, select LoanApplication data object. - Click Add.
- To create properties of the data object, right-click the property cell and select Insert column right or Insert column left as required. Create two more property cells under the EXPECT column.
Click the first property cell,
-
From Test Tools
Test Editor, select and expand the LoanApplication data object. - Click approved and then Add to map the data object field to the property cell.
-
From Test Tools
Click the second property cell,
-
From Test Tools
Test Editor, select and expand the LoanApplication data object. - Click insuranceCost and then Add.
-
From Test Tools
Click the third property cell,
-
From Test Tools
Test Editor, select and expand the LoanApplication data object. - Click approvedRate and then Add.
-
From Test Tools
Now for defining the test scenario, enter the following data in the first row:
-
Enter
Row 1 test scenario
as the Scenario Description,150000
as the amount,19000
as the deposit,30
as the lenghtYears, andAsset
as the type for the GIVEN column values. -
Enter
true
as approved and0
as the insuranceCost for the EXPECT column values.
-
Enter
Next enter the following data in the second row:
-
Enter
Row 2 test scenario
as the Scenario Description,100002
as the amount,2999
as the deposit,20
as the lenghtYears, andJob
as the type for the GIVEN column values. -
Enter
true
as approved and10
as the insuranceCost for the EXPECT column values.
-
Enter
- After you have defined all GIVEN, EXPECT, and other data for the scenario, click Save in the test scenarios designer to save your work.
Click Run Test in the upper-right corner to run the
.scesim
file.The test result is displayed in the Test Report panel. Click View Alerts to display messages from the Alerts section. If a test fails, refer to the messages in the Alerts section at the bottom of the window, review and correct all components in the scenario, and try again to validate the scenario until the scenario passes.
- Click Save in the test scenarios designer to save your work after you have made all necessary changes.