1.7. Creating a ServingRuntime CR for use in MicroShift

Procedure

1. Extract the image reference of the ServingRuntime CR you want to use from the MicroShift release information file by running the following command:

   $ OVMS_IMAGE="$(jq -r '.images | with_entries(select(.key == "ovms-image")) | .[]' /usr/share/microshift/release/release-ai-model-serving-"$(uname -i)".json)" 

   1

   1

   In this example, the image reference for the OVMS model-serving runtime is extracted.

2. Copy the original ServingRuntime YAML file by running the following command:

   $ cp /usr/lib/microshift/manifests.d/050-microshift-ai-model-serving-runtimes/ovms-kserve.yaml ./ovms-kserve.yaml

3. Add the actual image reference to the image: parameter field value of the ServingRuntime YAML by running the following command:

   $ sed -i "s,image: ovms-image,image: ${OVMS_IMAGE}," ./ovms-kserve.yaml

4. Create the ServingRuntime object in a custom namespace using the YAML file by running the following command:

   $ oc create -n <ai_demo> -f ./ovms-kserve.yaml 

   1

   1

   Replace <ai_demo> with the name of your namespace.