第 7 章 配额

1. 运行以下命令:

   $ oc create quota <name> \
       --hard=count/<resource>.<group>=<quota>,count/<resource>.<group>=<quota> 

   1

   Copy to Clipboard Toggle word wrap

   1

   <resource> 变量是资源名称，<group> 则是 API 组（如果适用）。使用 oc api-resources 命令可以列出资源及其关联的 API 组。

   例如：

   $ oc create quota test \
       --hard=count/deployments.extensions=2,count/replicasets.extensions=4,count/pods=3,count/secrets=4

   Copy to Clipboard Toggle word wrap

   输出示例

   resourcequota "test" created

   Copy to Clipboard Toggle word wrap

   本例将列出的资源限制为集群中各个项目的硬限值。

2. 验证是否创建了配额：

   $ oc describe quota test

   Copy to Clipboard Toggle word wrap

   输出示例

   Name:                         test
   Namespace:                    quota
   Resource                      Used  Hard
   --------                      ----  ----
   count/deployments.extensions  0     2
   count/pods                    0     3
   count/replicasets.extensions  0     4
   count/secrets                 0     4

   Copy to Clipboard Toggle word wrap

流程

1. 确定集群中某个节点中有多少 GPU 可用。例如：

   # oc describe node ip-172-31-27-209.us-west-2.compute.internal | egrep 'Capacity|Allocatable|gpu'

   Copy to Clipboard Toggle word wrap

   输出示例

                       openshift.com/gpu-accelerator=true
   Capacity:
    nvidia.com/gpu:  2
   Allocatable:
    nvidia.com/gpu:  2
     nvidia.com/gpu  0           0

   Copy to Clipboard Toggle word wrap

   本例中有 2 个 GPU 可用。

2. 在命名空间 nvidia 中设置配额。本例中配额为 1：

   # cat gpu-quota.yaml

   Copy to Clipboard Toggle word wrap

   输出示例

   apiVersion: v1
   kind: ResourceQuota
   metadata:
     name: gpu-quota
     namespace: nvidia
   spec:
     hard:
       requests.nvidia.com/gpu: 1

   Copy to Clipboard Toggle word wrap

3. 创建配额：

   # oc create -f gpu-quota.yaml

   Copy to Clipboard Toggle word wrap

   输出示例

   resourcequota/gpu-quota created

   Copy to Clipboard Toggle word wrap

4. 验证命名空间是否设置了正确的配额：

   # oc describe quota gpu-quota -n nvidia

   Copy to Clipboard Toggle word wrap

   输出示例

   Name:                    gpu-quota
   Namespace:               nvidia
   Resource                 Used  Hard
   --------                 ----  ----
   requests.nvidia.com/gpu  0     1

   Copy to Clipboard Toggle word wrap

5. 定义一个请求单个 GPU 的 Pod。以下示例定义文件名为 gpu-pod.yaml：

   apiVersion: v1
   kind: Pod
   metadata:
     generateName: gpu-pod-
     namespace: nvidia
   spec:
     restartPolicy: OnFailure
     containers:
     - name: rhel7-gpu-pod
       image: rhel7
       env:
         - name: NVIDIA_VISIBLE_DEVICES
           value: all
         - name: NVIDIA_DRIVER_CAPABILITIES
           value: "compute,utility"
         - name: NVIDIA_REQUIRE_CUDA
           value: "cuda>=5.0"
       command: ["sleep"]
       args: ["infinity"]
       resources:
         limits:
           nvidia.com/gpu: 1

   Copy to Clipboard Toggle word wrap

6. 创建 pod：

   # oc create -f gpu-pod.yaml

   Copy to Clipboard Toggle word wrap

7. 验证 Pod 是否在运行：

   # oc get pods

   Copy to Clipboard Toggle word wrap

   输出示例

   NAME              READY     STATUS      RESTARTS   AGE
   gpu-pod-s46h7     1/1       Running     0          1m

   Copy to Clipboard Toggle word wrap

8. 验证配额计数器 Used 是否正确：

   # oc describe quota gpu-quota -n nvidia

   Copy to Clipboard Toggle word wrap

   输出示例

   Name:                    gpu-quota
   Namespace:               nvidia
   Resource                 Used  Hard
   --------                 ----  ----
   requests.nvidia.com/gpu  1     1

   Copy to Clipboard Toggle word wrap

9. 尝试在 nvidia 命名空间中创建第二个 GPU Pod。从技术上讲这是可行的，因为它有 2 个 GPU：

   # oc create -f gpu-pod.yaml

   Copy to Clipboard Toggle word wrap

   输出示例

   Error from server (Forbidden): error when creating "gpu-pod.yaml": pods "gpu-pod-f7z2w" is forbidden: exceeded quota: gpu-quota, requested: requests.nvidia.com/gpu=1, used: requests.nvidia.com/gpu=1, limited: requests.nvidia.com/gpu=1

   Copy to Clipboard Toggle word wrap

   应该会显示此 Forbidden 错误消息，因为您有设为 1 个 GPU 的配额，但这一 Pod 试图分配第二个 GPU，而这超过了配额。