Chapter 3. Requirements for OpenShift AI

A subscription for Red Hat OpenShift Dedicated or a subscription for ROSA

You can deploy Red Hat OpenShift Dedicated on your Amazon Web Services (AWS) or Google Cloud Platform (GCP) account by using the Customer Cloud Subscription on AWS or Customer Cloud Subscription on GCP model. Note that while Red Hat provides an option to install OpenShift Dedicated on a Red Hat cloud account, if you want to install OpenShift AI then you must install OpenShift Dedicated on your own cloud account.

Contact your Red Hat account manager to purchase a new Red Hat OpenShift Dedicated subscription. If you do not yet have an account manager, complete the form at https://cloud.redhat.com/products/dedicated/contact/ to request one.

You can subscribe to Red Hat OpenShift Service on AWS (ROSA) directly from your AWS account or by contacting your Red Hat account manager.

A Red Hat customer account

Go to OpenShift Cluster Manager (http://console.redhat.com/openshift) and log in or register for a new account.

Cluster administrator access to your OpenShift cluster

Use an existing cluster or create a new cluster by following the steps in the relevant documentation:

An OpenShift Dedicated or ROSA cluster configuration that meets the following configuration requirements.

At least 2 worker nodes with at least 8 CPUs and 32 GiB RAM available for OpenShift AI to use when you install the Add-on. If this requirement is not met, the installation process fails to start and an error is displayed.

When you create a new cluster, select m6a.2xlarge for the computer node instance type to satisfy the requirements.

For an existing ROSA cluster, you can get the compute node instance type by using this command:

rosa list machinepools --cluster=cluster-name

You cannot alter a cluster’s compute node instance type, but you can add an additional machine pool or modify the default pool to meet the minimum requirements. However, the minimum resource requirements must be met by a single machine pool in the cluster.

For more information, see the relevant documentation:

For a ROSA cluster, select an access management strategy

For installing OpenShift AI on a ROSA cluster, decide whether you want to install on a ROSA cluster that uses AWS Security Token Service (STS) or one that uses AWS Identity and Access Management (IAM) credentials. See Install ROSA Classic clusters for advice on deploying a ROSA cluster with or without AWS STS.

Install the Red Hat OpenShift Pipelines Operator

OpenShift AI supports data science pipelines. A pipeline is a collection of Task resources that are arranged in a specific order of execution. By using Red Hat OpenShift AI pipelines, you can standardize and automate machine learning workflows to automate the build and deployment of your data science models. Before you can use pipelines with OpenShift AI, install the Red Hat OpenShift Pipelines Operator as described in Installing OpenShift Pipelines.

Install KServe dependencies

To support KServe components, you must install dependent Operators, including the Red Hat OpenShift Serverless and Red Hat OpenShift Service Mesh Operators. For more information, see Serving large language models.