Chapter 4. Installing RHEL AI on Google Cloud

Procedure

1. Log in to gcloud. Run the following command:

   $ gcloud auth login

2. Configure gcloud and create your Google Cloud storage container.

   1. Configure the gcloud CLI to use your project.

      $ GCLOUD_PROJECT=rhelai-gcloud-project

      $ gcloud config set project $GCLOUD_PROJECT

   2. Create an environment variable defining the region where you want to operate. For example:

      $ gcloud_region=us-central1

   3. Create a storage container. Run the following commands:

      $ GCLOUD_BUCKET=<YOUR_BUCKET_NAME>

      $ gsutil mb -l $gcloud_region gs://$GCLOUD_BUCKET

3. Download the tar.gz image from the Download Red Hat Enterprise Linux AI page.

4. Unzip the tar.gz file with the following command:

   $ gunzip <DOWNLOADED_TAR_GZ_FILE>

5. Configure the IMAGE_NAME variable:

   $ IMAGE_NAME=rhel-ai-gcloud

6. Upload the tar.gz file to the Google Cloud Storage Container by running the following command:

   $ gsutil cp <DOWNLOADED_TAR_GZ_FILE> "gs://${GCLOUD_BUCKET}/$IMAGE_NAME.tar.gz"

7. Create a Google Cloud image from the tar.gz file:

   $ gcloud compute images create \
   "$IMAGE_NAME" \
   --source-uri="gs://${GCLOUD_BUCKET}/$IMAGE_NAME.tar.gz" \
   --family "rhel-ai" \
   --guest-os-features=GVNIC

Procedure

1. Log in to your Google Cloud account by running the following command:

   $ gcloud auth login

2. Create several gcloud configuration variables for the deployment.

3. Select the instance profile that you want to use for the deployment. List all the profiles in the required region by running the following command:

   $ gcloud compute machine-types list --zones=<ZONE>

   Make a note of the preferred machine type.

4. Create Google Cloud instance variables, for example:

   NAME=rhelai-instance
   ZONE=us-central1-a
   MACHINE_TYPE=a3-highgpu-8g
   ACCELERATOR="type=nvidia-h100-80gb,count=8"
   IMAGE=custom-rhelai-image
   DISK_SIZE=1024
   SUBNET=default

5. Configure the zone.

   $ gcloud config set compute/zone $ZONE

6. Launch the Google Cloud instance:

   $ gcloud compute instances create \
       ${name} \
       --machine-type ${MACHINE_TYPE} \
       --image $IMAGE \
       --zone $ZONE \
       --subnet $SUBNET \
       --boot-disk-size ${DISK_SIZE} \
       --boot-disk-device-name ${NAME} \
       --accelerator=$ACCELERATOR