红帽全球峰会1.5. Installing the Red Hat OpenShift AI RPM
To use AI models in MicroShift deployments, install the Red Hat OpenShift AI (Red Hat OpenShift AI Self-Managed) RPM with a new MicroShift installation. You can also install the RPM on an existing MicroShift instance if you restart the system.
The microshift-ai-model-serving RPM contains manifests that deploy kserve, with the raw deployment mode enabled, and ServingRuntimes objects in the redhat-ods-applications namespace.
Red Hat OpenShift AI is a Technology Preview feature only. Technology Preview features are not supported with Red Hat production service level agreements (SLAs) and might not be functionally complete. Red Hat does not recommend using them in production. These features provide early access to upcoming product features, enabling customers to test functionality and provide feedback during the development process.
For more information about the support scope of Red Hat Technology Preview features, see the following link:
Prerequisites
- The system requirements for installing MicroShift have been met.
- You have root user access to your machine.
-
The OpenShift CLI (
oc) is installed. - You configured your LVM VG with the capacity needed for the PVs of your workload.
- You have the RAM and disk space required for your AI model.
- You configured the required accelerators, hardware, operating system, and MicroShift to provide the resources your model needs.
- Your AI model is ready to use.
Procedure
Install the MicroShift AI-model-serving RPM package by running the following command:
$ sudo dnf install microshift-ai-model-servingAs a root user, restart the MicroShift service by entering the following command:
$ sudo systemctl restart microshiftOptional: Install the release information package by running the following command:
$ sudo dnf install microshift-ai-model-serving-release-info注意The
microshift-ai-model-serving-release-infoRPM contains a JSON file with image references useful for offline procedures or deploying a copy of aServingRuntimeCustom Resource to your namespace during a bootc image build.
Verification
Verify that the
kservepod is running in theredhat-ods-applicationsnamespace by entering the following command:$ oc get pods -n redhat-ods-applicationsExample output
NAME READY STATUS RESTARTS AGE kserve-controller-manager-7fc9fc688-kttmm 1/1 Running 0 1h
Next steps
- Create a namespace for your AI model.
- Package your model into an OCI image.
- Configure a model-serving runtime.
- Verify that your model is ready for inferencing.
- Make requests against the model server.
'%20d='M201.5%20305.5c-13.8%200-24.9-11.1-24.9-24.6%200-13.8%2011.1-24.9%2024.9-24.9%2013.6%200%2024.6%2011.1%2024.6%2024.9%200%2013.6-11.1%2024.6-24.6%2024.6zM504%20256c0%20137-111%20248-248%20248S8%20393%208%20256%20119%208%20256%208s248%20111%20248%20248zm-132.3-41.2c-9.4%200-17.7%203.9-23.8%2010-22.4-15.5-52.6-25.5-86.1-26.6l17.4-78.3%2055.4%2012.5c0%2013.6%2011.1%2024.6%2024.6%2024.6%2013.8%200%2024.9-11.3%2024.9-24.9s-11.1-24.9-24.9-24.9c-9.7%200-18%205.8-22.1%2013.8l-61.2-13.6c-3-.8-6.1%201.4-6.9%204.4l-19.1%2086.4c-33.2%201.4-63.1%2011.3-85.5%2026.8-6.1-6.4-14.7-10.2-24.1-10.2-34.9%200-46.3%2046.9-14.4%2062.8-1.1%205-1.7%2010.2-1.7%2015.5%200%2052.6%2059.2%2095.2%20132%2095.2%2073.1%200%20132.3-42.6%20132.3-95.2%200-5.3-.6-10.8-1.9-15.8%2031.3-16%2019.8-62.5-14.9-62.5zM302.8%20331c-18.2%2018.2-76.1%2017.9-93.6%200-2.2-2.2-6.1-2.2-8.3%200-2.5%202.5-2.5%206.4%200%208.6%2022.8%2022.8%2087.3%2022.8%20110.2%200%202.5-2.2%202.5-6.1%200-8.6-2.2-2.2-6.1-2.2-8.3%200zm7.7-75c-13.6%200-24.6%2011.1-24.6%2024.9%200%2013.6%2011.1%2024.6%2024.6%2024.6%2013.8%200%2024.9-11.1%2024.9-24.6%200-13.8-11-24.9-24.9-24.9z'/%3e%3c/svg%3e){kind=small}