9.18.10.2.3. Binding PCI devices to the VFIO driver

Procedure

1. Run the lspci command to obtain the vendor-ID and the device-ID for the PCI device.

   $ lspci -nnv | grep -i nvidia

   Example output:

   02:01.0 3D controller [0302]: NVIDIA Corporation GV100GL [Tesla V100 PCIe 32GB] [10de:1eb8] (rev a1)

2. Create a Butane config file, 100-worker-vfiopci.bu, binding the PCI device to the VFIO driver.

   注記

   The Butane version you specify in the config file should match the OpenShift Container Platform version and always ends in 0. For example, 4.21.0. See "Creating machine configs with Butane" for information about Butane.

   Example:

   variant: openshift
   version: 4.21.0
   metadata:
     name: 100-worker-vfiopci
     labels:
       machineconfiguration.openshift.io/role: worker
   storage:
     files:
     - path: /etc/modprobe.d/vfio.conf
       mode: 0644
       overwrite: true
       contents:
         inline: |
           options vfio-pci ids=10de:1eb8 

   1

   
     - path: /etc/modules-load.d/vfio-pci.conf 

   2

   
       mode: 0644
       overwrite: true
       contents:
         inline: vfio-pci

   • metadata.labels.machineconfiguration.openshift.io/role: worker specifies that the new kernel argument is applied only to worker nodes.
   • storage.files.contents.inline, where the path is /etc/modprobe.d/vfio.conf, specifies the previously determined vendor-ID value (10de) and the device-ID value (1eb8) to bind a single device to the VFIO driver. You can add a list of multiple devices with their vendor and device information.
   • storage.files.path, where the contents.inline is vfio-pci, specifies the file that loads the vfio-pci kernel module on the worker nodes.

3. Use Butane to generate a MachineConfig object file, 100-worker-vfiopci.yaml, containing the configuration to be delivered to the worker nodes:

   $ butane 100-worker-vfiopci.bu -o 100-worker-vfiopci.yaml

4. Apply the MachineConfig object to the worker nodes:

   $ oc apply -f 100-worker-vfiopci.yaml

5. Verify that the MachineConfig object was added.

   $ oc get MachineConfig

   Example output:

   NAME                             GENERATEDBYCONTROLLER                      IGNITIONVERSION  AGE
   00-master                        d3da910bfa9f4b599af4ed7f5ac270d55950a3a1   3.5.0            25h
   00-worker                        d3da910bfa9f4b599af4ed7f5ac270d55950a3a1   3.5.0            25h
   01-master-container-runtime      d3da910bfa9f4b599af4ed7f5ac270d55950a3a1   3.5.0            25h
   01-master-kubelet                d3da910bfa9f4b599af4ed7f5ac270d55950a3a1   3.5.0            25h
   01-worker-container-runtime      d3da910bfa9f4b599af4ed7f5ac270d55950a3a1   3.5.0            25h
   01-worker-kubelet                d3da910bfa9f4b599af4ed7f5ac270d55950a3a1   3.5.0            25h
   100-worker-iommu                                                            3.5.0            30s
   100-worker-vfiopci-configuration                                            3.5.0            30s