Chapter 29. KIE Server clusters in a runtime environment

Procedure

1. Download Red Hat JBoss EAP 7.4 on each node of the cluster:

   1. Navigate to the Software Downloads page in the Red Hat Customer Portal (login required) and select the product and version from the drop-down options:

      • Product: Enterprise Application Platform
      • Version: 7.4
   2. Click Download next to Red Hat JBoss Enterprise Application Platform 7.4.1. (jboss-eap-7.4.1.zip).
2. Extract the jboss-eap-7.4.1.zip file. The jboss-eap-7.4/jboss-eap-7.4 directory is referred to as EAP_HOME.
3. Download and apply the latest Red Hat JBoss EAP patch, if available.

4. Download KIE Server:

   1. Navigate to the Software Downloads page in the Red Hat Customer Portal and select the product and version from the drop-down options:

      • Product: Process Automation Manager
      • Version: 7.12
   2. Download Red Hat Process Automation Manager 7.12.0 KIE Server for All Supported EE8 Containers (rhpam-7.12.0-kie-server-ee8.zip).
5. Extract the rhpam-7.12.0-kie-server-ee8.zip archive to a temporary directory. In the following examples this directory is called TEMP_DIR.

6. Copy the TEMP_DIR/rhpam-7.12.0-kie-server-ee8/rhpam-7.12.0-kie-server-ee8/kie-server.war directory to EAP_HOME/standalone/deployments/.

   Warning

   Ensure the names of the Red Hat Process Automation Manager deployments you copy do not conflict with your existing deployments in the Red Hat JBoss EAP instance.

7. Copy the contents of the TEMP_DIR/rhpam-7.12.0-kie-server-ee8/rhpam-7.12.0-kie-server-ee8/SecurityPolicy/ to EAP_HOME/bin.
8. When prompted to overwrite files, click Replace.
9. In the EAP_HOME/standalone/deployments/ directory, create an empty file named kie-server.war.dodeploy. This file ensures that KIE Server is automatically deployed when the server starts.
10. Download and apply the latest Red Hat Process Automation Manager patch, if available.
11. Navigate to the EAP_HOME/bin directory.

12. Create a user with the kie-server role that you will use to log in to KIE Server.

    $ ./bin/jboss-cli.sh --commands="embed-server --std-out=echo,/subsystem=elytron/filesystem-realm=ApplicationRealm:add-identity(identity=<USERNAME>),/subsystem=elytron/filesystem-realm=ApplicationRealm:set-password(identity=<USERNAME>, clear={password='<PASSWORD>'}),/subsystem=elytron/filesystem-realm=ApplicationRealm:add-identity-attribute(identity=<USERNAME>, name=role, value=['kie-server'])"

13. Make a note of your user names and passwords.

Procedure

1. Install the JDBC driver on all Red Hat JBoss EAP instances that are part of this cluster. For more information, see the "JDBC Drivers" section of the Red Hat JBoss EAP 7.4 Configuration Guide.
2. Open the EAP_HOME/standalone/configuration/standalone-full.xml file in a text editor.

3. Edit the data-stores property and the timer-service thread-pool-name above it:

   • The datasource-jndi-name is the JNDI name of the database specified at the beginning of this procedure.
   • You can enter any name for the value of the partition property. However, a node will only see timers from other nodes that have the same partition name. Grouping nodes into partitions by assigning partition names enables you to break a large cluster up into several smaller clusters. Doing this improves performance. For example, instead of having a cluster of 100 nodes, where all 100 nodes are trying to execute and refresh the same timers, you can create 20 clusters of 5 nodes by giving every group of 5 a different partition name.
   • Replace the default-data-store attribute value with ejb_timer_ds.

   • Set the value of refresh-interval in milliseconds to specify how often the EJB timer connects to the database to synchronize and load tasks to be processed.

     <timer-service thread-pool-name="default" default-data-store="ejb_timer_ds">
     <data-stores>
         <database-data-store name="ejb_timer_ds" datasource-jndi-name="java:jboss/datasources/ejb_timer" database="postgresql" partition="ejb_timer_part" refresh-interval="30000"/>
     </data-stores>
     </timer-service>

     The following table lists the supported databases and the corresponding database attribute value:

     Table 29.1. Supported databases

     Database	Attribute value
     Hyper SQL (for demonstration purposes only, not supported)	hsql
     PostgreSQL	postgresql
     Oracle	oracle
     IBM DB2	db2
     Microsoft SQL Server	mssql
     MySQL and MariaDB	mysql

4. Add the KIE Server and EJB timer data sources to the standalone-full.xml file. In these examples, <DATABASE> is the name of the database, <SERVER_NAME> is the host name of the JNDI database, and <USER_NAME> and <USER_PWD> are the credentials for that database.

   • Add the data source to allow KIE Server to connect to the database, for example:

     <xa-datasource jndi-name="java:/jboss/datasources/rhpam" pool-name="rhpam-RHPAM" use-java-context="true" enabled="true">
       <xa-datasource-property name="DatabaseName"><DATABASE></xa-datasource-property>
       <xa-datasource-property name="PortNumber">5432</xa-datasource-property>
       <xa-datasource-property name="ServerName"><SERVER_NAME></xa-datasource-property>
       <driver>postgresql</driver>
       <security>
         <user-name><USER_NAME></user-name>
         <password><USER_PWD></password>
     </security>
     </xa-datasource>

   • Add the data source to enable the EJB timer, for example:

     <xa-datasource jndi-name="java:jboss/datasources/ejb_timer" pool-name="ejb_timer" use-java-context="true" enabled="true">
         <xa-datasource-property name="DatabaseName"><DATABASE></xa-datasource-property>
         <xa-datasource-property name="PortNumber">5432</xa-datasource-property>
         <xa-datasource-property name="ServerName"><SERVER_NAME></xa-datasource-property>
         <driver>postgresql</driver>
         <transaction-isolation>TRANSACTION_READ_COMMITTED</transaction-isolation>
         <security>
             <user-name><USER_NAME></user-name>
             <password><USER_PWD></password>
         </security>
     </xa-datasource>

     Warning

     You must use two different databases for KIE Server runtime data and EJB timer data.

5. Add the following properties to the <system-properties> element and replace the following placeholders:

   • <JNDI_NAME> is the JNDI name of your data source. For Red Hat Process Automation Manager, this is java:/jboss/datasources/rhpam.

   • <DIALECT> is the hibernate dialect for your database.

     The following dialects are supported:

     • DB2: org.hibernate.dialect.DB2Dialect
     • MSSQL: org.hibernate.dialect.SQLServer2012Dialect
     • MySQL: org.hibernate.dialect.MySQL5InnoDBDialect
     • MariaDB: org.hibernate.dialect.MySQL5InnoDBDialect
     • Oracle: org.hibernate.dialect.Oracle10gDialect
     • PostgreSQL: org.hibernate.dialect.PostgreSQL82Dialect

     • PostgreSQL plus: org.hibernate.dialect.PostgresPlusDialect

       <system-properties>
         <property name="org.kie.server.persistence.ds" value="<JNDI_NAME>"/>
         <property name="org.kie.server.persistence.dialect" value="<DIALECT>"/>
         <property name="org.jbpm.ejb.timer.tx" value="true"/>
       </system-properties>

6. Save the standalone-full.xml file.

7. To start the cluster, navigate to EAP_HOME/bin and enter one of the following commands:

   • On Linux or UNIX-based systems:

     $ ./standalone.sh -c standalone-full.xml

   • On Windows:

     standalone.bat -c standalone-full.xml

Procedure

1. Navigate to the Software Downloads page in the Red Hat Customer Portal (login required), and select the product and version from the drop-down options:

   • Product: Process Automation Manager
   • Version: 7.12
2. Download Red Hat Process Automation Manager 7.12.0 Add Ons (the rhpam-7.12.0-add-ons.zip file).
3. Extract the rhpam-7.12.0-add-ons.zip file. The rhpam-7.12.0-controller-ee7.zip file is in the extracted directory.
4. Extract the rhpam-7.12.0-controller-ee7.zip archive to a temporary directory. In the following examples this directory is called TEMP_DIR.

5. Copy the TEMP_DIR/rhpam-7.12.0-controller-ee7/controller.war directory to EAP_HOME/standalone/deployments/.

   Warning

   Ensure that the names of the headless Process Automation Manager controller deployments you copy do not conflict with your existing deployments in the Red Hat JBoss EAP instance.

6. Copy the contents of the TEMP_DIR/rhpam-7.12.0-controller-ee7/SecurityPolicy/ directory to EAP_HOME/bin.
7. When prompted to overwrite files, click Yes.
8. In the EAP_HOME/standalone/deployments/ directory, create an empty file named controller.war.dodeploy. This file ensures that the headless Process Automation Manager controller is automatically deployed when the server starts.
9. Open the EAP_HOME/standalone/configuration/standalone.xml file in a text editor.

10. Add the following properties to the <system-properties> element and replace <NFS_STORAGE> with the absolute path to the NFS storage where the template configuration is stored:

    <system-properties>
      <property name="org.kie.server.controller.templatefile.watcher.enabled" value="true"/>
      <property name="org.kie.server.controller.templatefile" value="<NFS_STORAGE>"/>
    </system-properties>

    Template files contain default configurations for specific deployment scenarios.

    If the value of the org.kie.server.controller.templatefile.watcher.enabled property is set to true, a separate thread is started to watch for modifications of the template file. The default interval for these checks is 30000 milliseconds and can be further controlled by the org.kie.server.controller.templatefile.watcher.interval system property. If the value of this property is set to false, changes to the template file are detected only when the server restarts.

11. To start the headless Process Automation Manager controller, navigate to EAP_HOME/bin and enter the following command:

    • On Linux or UNIX-based systems:

      $ ./standalone.sh

    • On Windows:

      standalone.bat

Procedure

1. Prepare the environment:

   1. Verify that the following extensions are present in the standalone.xml file and add them if necessary:

      <extension module="org.jboss.as.clustering.infinispan"/>
      <extension module="org.jboss.as.clustering.jgroups"/>

   2. In the standalone.xml file, locate the <subsystem xmlns="urn:jboss:domain:infinispan:9.0"> subsystem and create a cached container entry named jbpm that includes a cache named nodes and a cache named jobs as shown in the following example:

      <cache-container name="jbpm">
        <transport lock-timeout="60000"/>
        <replicated-cache name="nodes">
            <transaction mode="BATCH"/>
        </replicated-cache>
        <replicated-cache name="jobs">
            <transaction mode="BATCH"/>
        </replicated-cache>
      </cache-container>

   3. Add the jgroups subsystem for the replicated and distributed caches:

      <subsystem xmlns="urn:jboss:domain:jgroups:7.0">
          <channels default="ee">
              <channel name="ee" stack="udp" cluster="ejb"/>
          </channels>
          <stacks>
              <stack name="udp">
                  <transport type="UDP" socket-binding="jgroups-udp"/>
                  <protocol type="PING"/>
                  <protocol type="MERGE3"/>
                  <socket-protocol type="FD_SOCK" socket-binding="jgroups-udp-fd"/>
                  <protocol type="FD_ALL"/>
                  <protocol type="VERIFY_SUSPECT"/>
                  <protocol type="pbcast.NAKACK2"/>
                  <protocol type="UNICAST3"/>
                  <protocol type="pbcast.STABLE"/>
                  <protocol type="pbcast.GMS"/>
                  <protocol type="UFC"/>
                  <protocol type="MFC"/>
                  <protocol type="FRAG3"/>
                </stack>
                <stack name="tcp">
                  <transport type="TCP" socket-binding="jgroups-tcp"/>
                  <socket-protocol type="MPING" socket-binding="jgroups-mping"/>
                  <protocol type="MERGE3"/>
                  <socket-protocol type="FD_SOCK" socket-binding="jgroups-tcp-fd"/>
                  <protocol type="FD_ALL"/>
                  <protocol type="VERIFY_SUSPECT"/>
                  <protocol type="pbcast.NAKACK2"/>
                  <protocol type="UNICAST3"/>
                  <protocol type="pbcast.STABLE"/>
                  <protocol type="pbcast.GMS"/>
                  <protocol type="MFC"/>
                  <protocol type="FRAG3"/>
                </stack>
            </stacks>
          </subsystem>

   4. Configure the following interface:

      <interface name="private">
          <inet-address value="${jboss.bind.address.private:127.0.0.1}"/>
      </interface>

   5. Configure the following socket:

      <socket-binding name="jgroups-mping" interface="private" multicast-address="${jboss.default.multicast.address:230.0.0.4}" multicast-port="45700"/>
      
        <socket-binding name="jgroups-tcp" interface="private" port="7600"/>
        <socket-binding name="jgroups-tcp-fd" interface="private" port="57600"/>
        <socket-binding name="jgroups-udp" interface="private" port="55200" multicast-address="${jboss.default.multicast.address:230.0.0.4}" multicast-port="45688"/>
        <socket-binding name="jgroups-udp-fd" interface="private" port="54200"/>

2. Add the Infinispan extension to KIE Server:

   1. Open the kie-server.war/WEB-INF/jboss-deployment-structure.xml file in a text editor and add the following dependencies to the file:

          <module name="org.infinispan" services="export"/>
          <module name="org.jgroups" />

   2. Download the JAR file.

      1. Navigate to the Software Downloads page in the Red Hat Customer Portal (login required), and select the product and version from the drop-down options:

         • Product: Process Automation Manager
         • Version: 7.12
      2. Download Red Hat Process Automation Manager 7.12.0 Maven Repository (rhpam-7.12.0-maven-repository.zip) and extract the ZIP file.
      3. Navigate to the directory containing the extracted files and copy the maven-repository/org/kie/server/kie-server-services-jbpm-cluster/7.59.0.Final-redhat-00006/kie-server-services-jbpm-cluster-7.59.0.Final-redhat-00006.jar file to the kie-server.war/WEB-INF/lib directory.