3.3. Managing distributed workloads with the Leader Worker Set Operator
You can use the Leader Worker Set Operator to manage distributed inference workloads and process large-scale inference requests efficiently.
3.3.1. Installing the Leader Worker Set Operator 复制链接链接已复制到粘贴板!
复制链接链接已复制到粘贴板!
You can install the Leader Worker Set Operator through the OpenShift Container Platform web console to begin managing distributed AI workloads.
Prerequisites
-
You have access to the cluster with
cluster-adminprivileges. - You have access to the OpenShift Container Platform web console.
- You have installed the cert-manager Operator for Red Hat OpenShift.
Procedure
- Log in to the OpenShift Container Platform web console.
- Verify that the cert-manager Operator for Red Hat OpenShift is installed.
Install the Leader Worker Set Operator.
-
Navigate to Ecosystem
Software Catalog. - Enter Leader Worker Set Operator into the filter box.
- Select the Leader Worker Set Operator and click Install.
On the Install Operator page:
- The Update channel is set to stable-v1.0, which installs the latest stable release of Leader Worker Set Operator 1.0.
- Under Installation mode, select A specific namespace on the cluster.
- Under Installed Namespace, select Operator recommended Namespace: openshift-lws-operator.
Under Update approval, select one of the following update strategies:
- The Automatic strategy allows Operator Lifecycle Manager (OLM) to automatically update the Operator when a new version is available.
- The Manual strategy requires a user with appropriate credentials to approve the Operator update.
- Click Install.
-
Navigate to Ecosystem
Create the custom resource (CR) for the Leader Worker Set Operator:
-
Navigate to Installed Operators
Leader Worker Set Operator. - Under Provided APIs, click Create instance in the LeaderWorkerSetOperator pane.
- Click Create.
-
Navigate to Installed Operators