11.2. Configuring vGPU on the Compute nodes

Procedure

1. Copy the overcloud image and add the gpu suffix to the copied image.

   $ cp overcloud-full.qcow2 overcloud-full-gpu.qcow2

2. Install an ISO image generator tool from YUM.

   $ sudo yum install genisoimage -y

3. Download the NVIDIA GRID host driver RPM package that corresponds to your GPU device from the NVIDIA website. To determine which driver you need, see the NVIDIA Driver Downloads Portal.

   注記

   You must be a registered NVIDIA customer to download the drivers from the portal.

4. Create an ISO image from the driver RPM package and save the image in the nvidia-host directory.

   $ genisoimage -o nvidia-host.iso -R -J -V NVIDIA nvidia-host/
   I: -input-charset not specified, using utf-8 (detected in locale settings)
     9.06% done, estimate finish Wed Oct 31 11:24:46 2018
    18.08% done, estimate finish Wed Oct 31 11:24:46 2018
    27.14% done, estimate finish Wed Oct 31 11:24:46 2018
    36.17% done, estimate finish Wed Oct 31 11:24:46 2018
    45.22% done, estimate finish Wed Oct 31 11:24:46 2018
    54.25% done, estimate finish Wed Oct 31 11:24:46 2018
    63.31% done, estimate finish Wed Oct 31 11:24:46 2018
    72.34% done, estimate finish Wed Oct 31 11:24:46 2018
    81.39% done, estimate finish Wed Oct 31 11:24:46 2018
    90.42% done, estimate finish Wed Oct 31 11:24:46 2018
    99.48% done, estimate finish Wed Oct 31 11:24:46 2018
   Total translation table size: 0
   Total rockridge attributes bytes: 358
   Total directory bytes: 0
   Path table size(bytes): 10
   Max brk space used 0
   55297 extents written (108 MB)

5. Create a driver installation script that also disables the nouveau driver and generates a new initramfs. The following example script, install_nvidia.sh, disables the nouveau driver, generates a new initramfs, and installs the NVIDIA GRID host driver on the overcloud image:

   #/bin/bash
   
   cat <<EOF >/etc/modprobe.d/disable-nouveau.conf
   blacklist nouveau
   options nouveau modeset=0
   EOF
   echo 'omit_drivers+=" nouveau "' > /etc/dracut.conf.d/disable-nouveau.conf
   dracut -f
   
   # NVIDIA GRID package
   mkdir /tmp/mount
   mount LABEL=NVIDIA /tmp/mount
   rpm -ivh /tmp/mount/<host_driver>.rpm

   • Replace <host_driver> with the host driver downloaded in step 3.

6. Customize the overcloud image by attaching the ISO image that you generated in step 4, and running the driver installation script that you created in step 5:

   $ virt-customize --attach nvidia-packages.iso -a overcloud-full-gpu.qcow2  -v --run install_nvidia.sh
   [   0.0] Examining the guest ...
   libguestfs: launch: program=virt-customize
   libguestfs: launch: version=1.36.10rhel=8,release=6.el8_5.2,libvirt
   libguestfs: launch: backend registered: unix
   libguestfs: launch: backend registered: uml
   libguestfs: launch: backend registered: libvirt

7. Relabel the customized image with SELinux:

   $ virt-customize -a overcloud-full-gpu.qcow2 --selinux-relabel
   [   0.0] Examining the guest ...
   [   2.2] Setting a random seed
   [   2.2] SELinux relabelling
   [  27.4] Finishing off

8. Prepare the custom image files for upload to the OpenStack Image Service:

   $ mkdir /var/image/x86_64/image
   $ guestmount -a overcloud-full-gpu.qcow2 -i --ro image
   $ cp image/boot/vmlinuz-3.10.0-862.14.4.el8.x86_64 ./overcloud-full-gpu.vmlinuz
   $ cp image/boot/initramfs-3.10.0-862.14.4.el8.x86_64.img ./overcloud-full-gpu.initrd

9. From the undercloud, upload the custom image to the OpenStack Image Service:

   (undercloud) $ openstack overcloud image upload --update-existing --os-image-name overcloud-full-gpu.qcow2