3.5. 在经过存储优化的 Amazon EC2 - i3en.2xlarge 实例类型上创建 OpenShift Container Storage 集群

1. 使用 LocalVolume CR 创建 PV
2. 创建一个新的 StorageClass

步骤

1. 使用 LocalVolume 自定义资源 (CR) 在存储节点上创建本地持久性卷 (PV)。

   使用 OpenShift Storage Container 标签作为节点选择器和 by-id 设备标识符的 LocalVolume CR local-storage- block.yaml 示例：

   apiVersion: local.storage.openshift.io/v1
   kind: LocalVolume
   metadata:
     name: local-block
     namespace: openshift-local-storage
     labels:
       app: ocs-storagecluster
   spec:
     tolerations:
     - key: "node.ocs.openshift.io/storage"
       value: "true"
       effect: NoSchedule
     nodeSelector:
       nodeSelectorTerms:
         - matchExpressions:
             - key: cluster.ocs.openshift.io/openshift-storage
               operator: In
               values:
                 - ''
     storageClassDevices:
       - storageClassName: localblock
         volumeMode: Block
         devicePaths:
           - /dev/disk/by-id/nvme-Amazon_EC2_NVMe_Instance_Storage_AWS10382E5D7441494EC   # <-- modify this line
           - /dev/disk/by-id/nvme-Amazon_EC2_NVMe_Instance_Storage_AWS1F45C01D7E84FE3E9   # <-- modify this line
           - /dev/disk/by-id/nvme-Amazon_EC2_NVMe_Instance_Storage_AWS136BC945B4ECB9AE4   # <-- modify this line
           - /dev/disk/by-id/nvme-Amazon_EC2_NVMe_Instance_Storage_AWS10382E5D7441464EP   # <-- modify this line
           - /dev/disk/by-id/nvme-Amazon_EC2_NVMe_Instance_Storage_AWS1F45C01D7E84F43E7   # <-- modify this line
           - /dev/disk/by-id/nvme-Amazon_EC2_NVMe_Instance_Storage_AWS136BC945B4ECB9AE8   # <-- modify this line

   Copy to Clipboard Toggle word wrap

   每个 Amazon EC2 I3 实例都具有两个磁盘，本例在每个节点上同时使用两个磁盘。

2. 创建 LocalVolume CR。

   $ oc create -f local-storage-block.yaml

   Copy to Clipboard Toggle word wrap

   输出示例：

   localvolume.local.storage.openshift.io/local-block created

   Copy to Clipboard Toggle word wrap

3. 检查是否创建了 pod。

   $ oc -n openshift-local-storage get pods

   Copy to Clipboard Toggle word wrap

4. 检查是否创建了 PV。

   您必须为三个 worker 节点上的每个本地存储设备看到一个新的 PV。请参阅查找可用存储设备部分的示例，其中显示了每个 worker 节点的两个可用存储设备，每个节点的大小为 2.3 TiB。

   $ oc get pv

   Copy to Clipboard Toggle word wrap

   输出示例：

   NAME               CAPACITY ACCESS MODES  RECLAIM POLICY STATUS       CLAIM     STORAGECLASS  REASON   AGE
   local-pv-1a46bc79  2328Gi   RWO           Delete         Available              localblock             14m
   local-pv-429d90ee  2328Gi   RWO           Delete         Available              localblock             14m
   local-pv-4d0a62e3  2328Gi   RWO           Delete         Available              localblock             14m
   local-pv-55c05d76  2328Gi   RWO           Delete         Available              localblock             14m
   local-pv-5c7b0990  2328Gi   RWO           Delete         Available              localblock             14m
   local-pv-a6b283b   2328Gi   RWO           Delete         Available              localblock             14m

   Copy to Clipboard Toggle word wrap

5. 检查在创建 LocalVolume CR 时存在新的 StorageClass。这个 StorageClass 用于在以下步骤中提供 StorageCluster PVC。

   $ oc get sc | grep localblock

   Copy to Clipboard Toggle word wrap

   输出示例：

   NAME            PROVISIONER                    RECLAIMPOLICY
   VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION     AGE
   localblock      kubernetes.io/no-provisioner   Delete
   WaitForFirstConsumer  false                15m

   Copy to Clipboard Toggle word wrap

6. 创建 StorageCluster CR，它使用 localblock StorageClass 使用 Local Storage Operator 创建的 PV。

   使用 monDataDirHostPath 和 localblock StorageClass 的 StorageCluster CR ocs-cluster-service.yaml 示例。

   apiVersion: ocs.openshift.io/v1
   kind: StorageCluster
   metadata:
     name: ocs-storagecluster
     namespace: openshift-storage
   spec:
     manageNodes: false
     resources:
       mds:
         limits:
           cpu: 3
           memory: 8Gi
         requests:
           cpu: 1
           memory: 8Gi
     monDataDirHostPath: /var/lib/rook
     storageDeviceSets:
       - count: 2
         dataPVCTemplate:
           spec:
             accessModes:
               - ReadWriteOnce
             resources:
               requests:
                 storage: 2328Gi
             storageClassName: localblock
             volumeMode: Block
         name: ocs-deviceset
         placement: {}
         portable: false
         replica: 3
         resources:
           limits:
             cpu: 2
             memory: 5Gi
           requests:
             cpu: 1
             memory: 5Gi

   Copy to Clipboard Toggle word wrap
   重要

   为确保 OSD 在节点上具有有保证的大小，storageDeviceSet 的存储大小必须指定为小于或等于节点上创建的 PV 的大小。

7. 创建 StorageCluster CR。

   $ oc create -f ocs-cluster-service.yaml

   Copy to Clipboard Toggle word wrap

   输出示例

   storagecluster.ocs.openshift.io/ocs-cluster-service created

   Copy to Clipboard Toggle word wrap