Chapter 6. Deploying the Ansible Lightspeed intelligent assistant on OpenShift Container Platform

Procedure

1. Log in to Red Hat OpenShift Container Platform as an administrator.
2. Navigate to Workloads Secrets.
3. From the Projects list, select the namespace that you created when you installed the Ansible Automation Platform operator.
4. Click Create Key/value secret.
5. In the Secret name field, enter a unique name for the secret. For example, chatbot-configuration-secret.

6. Add the following keys and their associated values individually:

   Expand

   Key	Value
   Settings for all LLM setups
   chatbot_model	Enter the LLM model name that is configured on your LLM setup.
   chatbot_url	Enter the inference API base URL on your LLM setup. For example, https://your_inference_api/v1.
   chatbot_token	Enter the API token or the API key. This token is sent along with the authorization header when an inference API is called.
   chatbot_llm_provider_type	Optional Enter the provider type of your LLM setup by using one of the following values: Red Hat Enterprise Linux AI: rhelai_vllm Red Hat OpenShift AI: rhoai_vllm (Default value) IBM watsonx.ai: watsonx OpenAI: openai Microsoft Azure OpenAI: azure_openai
   chatbot_context_window_size	Optional Enter a value to configure the context window length for your LLM setup. Default= 128000
   chatbot_temperature_override	Optional A lower temperature generates predictable results, while a higher temperature allows more diverse or creative responses. Enter one of the following values: 0: Least creativity and randomness in the responses. 1: Maximum creativity and randomness in the responses. null: Override or disable the default temperature setting. Note A few OpenAI o-series models (o1, o3-mini, and o4-mini models) do not support the temperature settings. Therefore, you must set the value to null to use these OpenAI models.
   Additional setting for IBM watsonx.ai only
   chatbot_llm_provider_project_id	Enter the project ID of your IBM watsonx setup.
   Additional settings for Microsoft Azure OpenAI only
   chatbot_azure_deployment_name	Enter the deployment name of your Microsoft Azure OpenAI setup.
   chatbot_azure_api_version	Optional Enter the API version of your Microsoft Azure OpenAI setup.

   Show more
7. Click Create. The chatbot authorization secret is successfully created.

Procedure

1. Log in to Red Hat OpenShift Container Platform as an administrator.
2. Navigate to Operators Installed Operators.
3. From the list of installed operators, select the Ansible Automation Platform operator.
4. Locate and select the Ansible Automation Platform custom resource, and then click the required app.
5. Select the YAML tab.

6. Scroll the text to find the spec: section, and add the following details under the spec: section:

   spec:
     lightspeed:
       disabled: false
       chatbot_config_secret_name: <name of your chatbot configuration secret>

   Copy to Clipboard Toggle word wrap
7. Click Save. The Ansible Lightspeed intelligent assistant service takes a few minutes to set up.

Verification

1. Verify that the chat interface service is running successfully:

   1. Navigate to Workloads Pods.

   2. Filter with the term api and ensure that the following APIs are displayed in Running status:

      • myaap-lightspeed-api-<version number>
      • myaap-lightspeed-chatbot-api-<version number>

2. Verify that the chat interface is displayed on the Ansible Automation Platform:

   1. Access the Ansible Automation Platform:

      1. Navigate to Operators Installed Operators.
      2. From the list of installed operators, click Ansible Automation Platform.
      3. Locate and select the Ansible Automation Platform custom resource, and then click the app that you created.

      4. From the Details tab, record the information available in the following fields:

         • URL: This is the URL of your Ansible Automation Platform instance.
         • Gateway Admin User: This is the username to log into your Ansible Automation Platform instance.
         • Gateway Admin password: This is the password to log into your Ansible Automation Platform instance.
      5. Log in to the Ansible Automation Platform using the URL, username, and password that you recorded earlier.

   2. Access the Ansible Lightspeed intelligent assistant:

      1. Click the Ansible Lightspeed intelligent assistant icon that is displayed at the top right corner of the taskbar.

      2. Verify that the chat interface is displayed, as shown in the following image:

         .