Chapter 1. Llama Stack to OGX migration

Procedure

1. Remove the Llama Stack Operator from your environment. You can remove the Llama Stack Operator by setting the component spec:

   $ dsc.spec.components.lls = "Removed"

2. Install the new OGX operator by setting the component spec:

   $ dsc.spec.components.ogx = "Managed"

3. Create the OGXServer custom resource (CR).

   apiVersion: ogx.io/v1beta1
   kind: OGXServer
   metadata:
     name: my-server
   spec:
     distribution:
       name: rh-dev
     workload:
       replicas: 1
       storage:
         size: "20Gi"
       overrides:
         env:
           - name: OLLAMA_INFERENCE_MODEL
             value: "llama3.2:1b"
           - name: OLLAMA_URL
             value: "http://ollama-server-service.ollama-dist.svc.cluster.local:11434"

4. Apply the OGXServer CR to the cluster:

   $ oc apply -f ogxserver.yaml

Verification

1. Verify the pod deployment with the following command:

   # Check the new CRD is registered
   $ oc get crd ogxservers.ogx.io
   
   # List OGXServer resources
   $ oc get ogxserver
   
   # Check conditions for adoption status
   $ oc get ogxserver my-server -o jsonpath='{.status.conditions}'
   
   # Verify the server is ready
   $ oc get ogxserver my-server -o jsonpath='{.status.phase}'

2. You can then clean up the legacy resources when the new OGXServer is verified.

   1. Remove the LlamaStackDistribution CR resources:

      $ oc delete llamastackdistribution <old-llsd-name> -n <namespace>

3. (Optional) Adopting existing PVC.

   1. To preserve existing data by adopting the PVC from the old LlamaStackDistribution, set the annotations parameter similar to the following:

      metadata:
        annotations:
          ogx.io/adopt-storage: "<old-llsd-name>"

      The operator strips the old ownerRef from the PVC and labels it for discovery. The adopted PVC intentionally has no ownerReference to the OGXServer.

4. (Optional) Adopting existing Service and Ingress

   1. To preserve ClusterIP and external endpoints, set the annotations similar to the following:

      metadata:
        annotations:
          ogx.io/adopt-storage: "<old-llsd-name>"
          ogx.io/adopt-networking: "<old-llsd-name>"