Red Hat SummitEste contenido no está disponible en el idioma seleccionado.
Chapter 1. Installing OpenShift Lightspeed
Enable OpenShift Lightspeed in your cluster by installing the OpenShift Lightspeed Operator and configuring the Service to interact with a large language model (LLM) provider.
1.1. Large language model (LLM) overview
Learn how the OpenShift Lightspeed Service uses large language models (LLMs) to generate intelligent, context-aware answers to your questions about OpenShift Container Platform.
You can configure Red Hat Enterprise Linux AI or Red Hat OpenShift AI as the LLM provider for the OpenShift Lightspeed Service. Either LLM provider can use a server or inference service that processes inference queries.
Alternatively, you can connect the OpenShift Lightspeed Service to a publicly available LLM provider, such as IBM watsonx, OpenAI, or Microsoft Azure OpenAI.
Installing the OpenShift Lightspeed Operator does not install an LLM provider. You must have an LLM provider available for use before you install the OpenShift Lightspeed Operator.
1.1.1. Red Hat Enterprise Linux AI with OpenShift Lightspeed
You can use Red Hat Enterprise Linux AI to host an LLM.
For more information, see Generating a custom LLM by using RHEL AI.
1.1.2. Red Hat OpenShift AI with OpenShift Lightspeed
You can use Red Hat OpenShift AI to host an LLM.
For more information, see About model serving.
1.1.3. IBM watsonx with OpenShift Lightspeed
To configure IBM watsonx as the LLM provider, you need an IBM Cloud project with access to IBM watsonx. You also need your IBM watsonx API key.
For more information, see the official IBM watsonx product documentation.
1.1.4. OpenAI with OpenShift Lightspeed
To configure OpenAI as the LLM provider with OpenShift Lightspeed, you need either the OpenAI API key or the OpenAI project name during the configuration process.
The OpenAI Service has a feature for projects and service accounts. You can use a service account in a dedicated project so that you can precisely track OpenShift Lightspeed usage.
For more information, see the official OpenAI product documentation.
1.1.5. Microsoft Azure OpenAI with OpenShift Lightspeed
To configure Microsoft Azure OpenAI as the LLM provider, you need a Microsoft Azure OpenAI Service instance. You must have at least one model deployment in Microsoft Azure OpenAI Studio for that instance.
For more information, see the official Microsoft Azure OpenAI product documentation.
1.2. About subscription requirements
Review the supported OpenShift Container Platform product subscriptions and account requirements necessary to activate and use the OpenShift Lightspeed Service in your environment.
Red Hat OpenShift Lightspeed requires a valid and active subscription to one of the listed products.
- Red Hat OpenShift Kubernetes Engine
- Red Hat OpenShift Virtualization Engine
- OpenShift Container Platform
- Red Hat OpenShift Platform Plus
1.3. About adding Operators to a cluster
Use the software catalog or OperatorHub to install Operators on your OpenShift Container Platform cluster. These tools use the Operator Lifecycle Manager (OLM) to manage your software.
1.3.1. Installing the OpenShift Lightspeed Operator from the OperatorHub
Install the OpenShift Lightspeed Operator so that you can configure the OpenShift Lightspeed Service.
Prerequisites
- You have deployed OpenShift Container Platform 4.16 to 4.19.
-
You have logged in to the OpenShift Container Platform web console as a user with the
cluster-adminrole. - You have successfully configured your large language model (LLM) provider so that OpenShift Lightspeed can communicate with it.
Procedure
-
In the OpenShift Container Platform web console, navigate to the Operators
OperatorHub page. - Search for OpenShift Lightspeed.
- Locate the OpenShift Lightspeed Operator, and click to select it.
- When the prompt that discusses the community operator displays, click Continue.
- Click Install.
- Use the default installation settings presented, and click Install to continue.
-
Click Operators
Installed Operators to verify the OpenShift Lightspeed Operator installation. Succeededdisplays in the Status column.
1.3.2. Installing the OpenShift Lightspeed Operator from the software catalog
Install the OpenShift Lightspeed Operator so that you can configure the OpenShift Lightspeed Service.
Prerequisites
- You have deployed OpenShift Container Platform 4.20 or later.
-
You have logged in to the OpenShift Container Platform web console as a user with the
cluster-adminrole. - You have successfully configured your large language model (LLM) provider so that OpenShift Lightspeed can communicate with it.
Procedure
-
In the OpenShift Container Platform web console, navigate to the Ecosystem
Software Catalog page. - Click the Project drop-down list, and enable the toggle switch to show default projects.
-
Enter
openshift-marketplacein the search field. -
Click to select
openshift-marketplace. - Search for OpenShift Lightspeed.
- Locate the OpenShift Lightspeed Operator, and click to select it.
- When the prompt that discusses the OpenShift Lightspeed Operator displays, click Install.
- Use the default installation settings presented, and click Install to continue.
-
Click Ecosystem
Installed Operators to verify the OpenShift Lightspeed Operator installation. Succeededdisplays in the Status column.
'%20d='M201.5%20305.5c-13.8%200-24.9-11.1-24.9-24.6%200-13.8%2011.1-24.9%2024.9-24.9%2013.6%200%2024.6%2011.1%2024.6%2024.9%200%2013.6-11.1%2024.6-24.6%2024.6zM504%20256c0%20137-111%20248-248%20248S8%20393%208%20256%20119%208%20256%208s248%20111%20248%20248zm-132.3-41.2c-9.4%200-17.7%203.9-23.8%2010-22.4-15.5-52.6-25.5-86.1-26.6l17.4-78.3%2055.4%2012.5c0%2013.6%2011.1%2024.6%2024.6%2024.6%2013.8%200%2024.9-11.3%2024.9-24.9s-11.1-24.9-24.9-24.9c-9.7%200-18%205.8-22.1%2013.8l-61.2-13.6c-3-.8-6.1%201.4-6.9%204.4l-19.1%2086.4c-33.2%201.4-63.1%2011.3-85.5%2026.8-6.1-6.4-14.7-10.2-24.1-10.2-34.9%200-46.3%2046.9-14.4%2062.8-1.1%205-1.7%2010.2-1.7%2015.5%200%2052.6%2059.2%2095.2%20132%2095.2%2073.1%200%20132.3-42.6%20132.3-95.2%200-5.3-.6-10.8-1.9-15.8%2031.3-16%2019.8-62.5-14.9-62.5zM302.8%20331c-18.2%2018.2-76.1%2017.9-93.6%200-2.2-2.2-6.1-2.2-8.3%200-2.5%202.5-2.5%206.4%200%208.6%2022.8%2022.8%2087.3%2022.8%20110.2%200%202.5-2.2%202.5-6.1%200-8.6-2.2-2.2-6.1-2.2-8.3%200zm7.7-75c-13.6%200-24.6%2011.1-24.6%2024.9%200%2013.6%2011.1%2024.6%2024.6%2024.6%2013.8%200%2024.9-11.1%2024.9-24.6%200-13.8-11-24.9-24.9-24.9z'/%3e%3c/svg%3e){kind=small}