Red Hat Summit Red Hat SummitSupportConsoleDevelopersStart a trialContact

Chapter 2. Activating the Llama Stack Operator

You can activate the Llama Stack Operator on your OpenShift cluster by setting its managementState to Managed in the OpenShift AI Operator DataScienceCluster custom resource (CR). This setting enables Llama-based model serving without reinstalling or directly editing Operator subscriptions. You can edit the CR in the OpenShift web console or by using the OpenShift CLI (oc).

Note

As an alternative to following the steps in this procedure, you can activate the Llama Stack Operator from the OpenShift CLI (oc) by running the following command: 

$ oc patch datasciencecluster <name> --type=merge -p {"spec":{"components":{"llamastackoperator":{"managementState":"Managed"}}}}
Copy to Clipboard Toggle word wrap

Replace <name> with your DataScienceCluster name, for example, default-dsc.

Prerequisites

Procedure

  1. Log in to the OpenShift web console as a cluster administrator.
  2. In the Administrator perspective, click Operators Installed Operators.
  3. Click the Red Hat OpenShift AI Operator to open its details.
  4. Click the Data Science Cluster tab.
  5. On the DataScienceClusters page, click the default-dsc object.

  6. Click the YAML tab.

    An embedded YAML editor opens, displaying the configuration for the DataScienceCluster custom resource.

  7. In the YAML editor, locate the spec.components section. If the llamastackoperator field does not exist, add it. Then, set the managementState field to Managed: 

    spec:
  components:
    llamastackoperator:
      managementState: Managed
    Copy to Clipboard Toggle word wrap
  8. Click Save to apply your changes.

Verification

After you activate the Llama Stack Operator, verify that it is running in your cluster:

  1. In the OpenShift web console, click Workloads Pods.
  2. From the Project list, select the redhat-ods-applications namespace.
  3. Confirm that a pod with the label app.kubernetes.io/name=llama-stack-operator is displayed and has a status of Running.
Red Hat logoGithubredditYoutubeTwitter

Learn

Try, buy, & sell

Communities

About Red Hat Documentation

We help Red Hat users innovate and achieve their goals with our products and services with content they can trust. Explore our recent updates.

Making open source more inclusive

Red Hat is committed to replacing problematic language in our code, documentation, and web properties. For more details, see the Red Hat Blog.

About Red Hat

We deliver hardened solutions that make it easier for enterprises to work across platforms and environments, from the core datacenter to the network edge.

Theme

© 2026 Red HatBack to top