第 2 章 对模型需要的镜像进行镜像(mirror)

流程

1. 查找与环境匹配的以下镜像版本，并使用 podman 拉取镜像：

   • Node Feature Discovery (NFD) Operator
   • NVIDIA GPU Operator
   • AI Inference Server

2. 创建包含 NFD Operator、Nvidia GPU Operator 和 AI Inference Server 镜像的镜像设置配置自定义资源(CR)。例如，将以下 ImageSetConfiguration CR 保存为文件 imageset-config.yaml ：

   apiVersion: mirror.openshift.io/v2alpha1
   kind: ImageSetConfiguration
   mirror:
     operators:
     # Node Feature Discovery (NFD) Operator
     # Helps Openshift detect hardware capabilities like GPUs
     - catalog: registry.redhat.io/openshift4/ose-cluster-nfd-operator:latest
       packages:
         - name: nfd
           defaultChannel: stable
           channels:
             - name: stable
   
     # GPU Operator
     # Manages NVIDIA GPUs on OpenShift
     - catalog: registry.connect.redhat.com/nvidia/gpu-operator-bundle:latest
       packages:
         - name: gpu-operator-certified
           defaultChannel: stable
           channels:
             - name: stable
     additionalImages:
     # Red Hat AI Inference Server image
     - name: registry.redhat.io/rhaiis/vllm-cuda-rhel9:latest
     # Model image
     - name: registry.redhat.io/rhelai1/granite-3-1-8b-instruct-quantized-w8a8:1.5

   Copy to Clipboard Toggle word wrap

3. 将所需的镜像镜像(mirror)到镜像 registry 中。运行以下命令:

   $ oc mirror --config imageset-config.yaml docker://<target_mirror_registry_url> --registry-config <path_to_pull_secret_json>

   Copy to Clipboard Toggle word wrap

4. 另外，如果您在集群中安装了 NFD 和 NVIDIA GPU Operator，请创建一个只配置 AI Inference Server 和 model 镜像的 ImageSetConfiguration CR：

   apiVersion: mirror.openshift.io/v2alpha1
   kind: ImageSetConfiguration
   mirror:
     additionalImages:
     - name: registry.redhat.io/rhaiis/vllm-cuda-rhel9:latest
     - registry.redhat.io/rhelai1/granite-3-1-8b-instruct-quantized-w8a8:1.5

   Copy to Clipboard Toggle word wrap
5. 在断开连接的环境中镜像设置 的镜像。
6. 将断开连接的集群配置为使用更新的镜像集。