1.3. Installing the Red Hat OpenShift AI RPM

Prerequisites

• The system requirements for installing MicroShift have been met.
• You have root user access to your machine.
• The OpenShift CLI (oc) is installed.
• You configured your LVM VG with the capacity needed for the PVs of your workload.
• You have the RAM and disk space required for your AI model.
• You configured the required accelerators, hardware, operating system, and MicroShift to provide the resources your model needs.
• Your AI model is ready to use.

Verification

• Verify that the kserve pod is running in the redhat-ods-applications namespace by entering the following command:

  $ oc get pods -n redhat-ods-applications

  Example output

  NAME                                        READY   STATUS    RESTARTS   AGE
  kserve-controller-manager-7fc9fc688-kttmm   1/1     Running   0          1h

Next steps

• Create a namespace for your AI model.
• Package your model into an OCI image.
• Configure a model-serving runtime.
• Verify that your model is ready for inferencing.
• Make requests against the model server.