Chapter 4. Installing RHEL AI on Google Cloud

Procedure

1. Log in to gcloud. Run the following command:

   $ gcloud auth login

   Copy to Clipboard Toggle word wrap

2. Configure gcloud and create your Google Cloud storage container.

   1. Configure the gcloud CLI to use your project.

      $ GCLOUD_PROJECT=rhelai-gcloud-project

      Copy to Clipboard Toggle word wrap

      $ gcloud config set project $GCLOUD_PROJECT

      Copy to Clipboard Toggle word wrap

   2. Create an environment variable defining the region where you want to operate. For example:

      $ gcloud_region=us-central1

      Copy to Clipboard Toggle word wrap

   3. Create a storage container. Run the following commands:

      $ GCLOUD_BUCKET=<YOUR_BUCKET_NAME>

      Copy to Clipboard Toggle word wrap

      $ gsutil mb -l $gcloud_region gs://$GCLOUD_BUCKET

      Copy to Clipboard Toggle word wrap
3. Download the tar.gz image from the Download Red Hat Enterprise Linux AI page.

4. Unzip the tar.gz file with the following command:

   $ gunzip <DOWNLOADED_TAR_GZ_FILE>

   Copy to Clipboard Toggle word wrap

5. Configure the IMAGE_NAME variable:

   $ IMAGE_NAME=rhel-ai-gcloud

   Copy to Clipboard Toggle word wrap

6. Upload the tar.gz file to the Google Cloud Storage Container by running the following command:

   $ gsutil cp <DOWNLOADED_TAR_GZ_FILE> "gs://${GCLOUD_BUCKET}/$IMAGE_NAME.tar.gz"

   Copy to Clipboard Toggle word wrap

7. Create a Google Cloud image from the tar.gz file:

   $ gcloud compute images create \
   "$IMAGE_NAME" \
   --source-uri="gs://${GCLOUD_BUCKET}/$IMAGE_NAME.tar.gz" \
   --family "rhel-ai" \
   --guest-os-features=GVNIC

   Copy to Clipboard Toggle word wrap

Procedure

1. Log in to your Google Cloud account by running the following command:

   $ gcloud auth login

   Copy to Clipboard Toggle word wrap
2. Create several gcloud configuration variables for the deployment.

3. Select the instance profile that you want to use for the deployment. List all the profiles in the required region by running the following command:

   $ gcloud compute machine-types list --zones=<ZONE>

   Copy to Clipboard Toggle word wrap

   Make a note of the preferred machine type.

4. Create Google Cloud instance variables, for example:

   NAME=rhelai-instance
   ZONE=us-central1-a
   MACHINE_TYPE=a3-highgpu-8g
   ACCELERATOR="type=nvidia-h100-80gb,count=8"
   IMAGE=custom-rhelai-image
   DISK_SIZE=1024
   SUBNET=default

   Copy to Clipboard Toggle word wrap

5. Configure the zone.

   $ gcloud config set compute/zone $ZONE

   Copy to Clipboard Toggle word wrap

6. Launch the Google Cloud instance:

   $ gcloud compute instances create \
       ${name} \
       --machine-type ${MACHINE_TYPE} \
       --image $IMAGE \
       --zone $ZONE \
       --subnet $SUBNET \
       --boot-disk-size ${DISK_SIZE} \
       --boot-disk-device-name ${NAME} \
       --accelerator=$ACCELERATOR

   Copy to Clipboard Toggle word wrap