Chapter 5. Installing RHEL AI on Google Cloud Platform (GCP)

Procedure

1. Log in to Google Cloud Platform with the following command:

   $ gcloud auth login

   Example output of the login.

   $ gcloud auth login
   Your browser has been opened to visit:
   
       https://accounts.google.com/o/oauth2/auth?XXXXXXXXXXXXXXXXXXXX
   
   
   You are now logged in as [user@example.com].
   Your current project is [your-project].  You can change this setting by running:
     $ gcloud config set project PROJECT_ID

2. You need to set up some Google Cloud Platform configurations and create your GCP Storage Container before creating the GCP image.

   1. Configure Google Cloud Platform CLI to use your project.

      $ gcloud_project=your-gcloud-project
      $ gcloud config set project $gcloud_project

   2. Create an environment variable defining the region where you want to operate.

      $ gcloud_region=us-central1

   3. Create a Google Cloud Platform Storage Container.

      $ gcloud_bucket=name-for-your-bucket
      $ gsutil mb -l $gcloud_region gs://$gcloud_bucket

3. Now that your GCP Storage Container is set up, you need to download the GCP tar.gz image from the Red Hat Enterprise Linux AI download page.

4. Unzip the tar.gz file with the following command:

   $ gunzip <downloaded-gcp-gz-image>

5. Set the name you want to use as the RHEL AI Google Cloud Platform image.

   $ image_name=rhel-ai-1-2

6. Upload the tar.gz file to the Google Cloud Platform Storage Container by running the following command:

   $ gsutil cp rhelai_gcp.tar.gz "gs://${gcloud_bucket}/$image_name.tar.gz"

7. Create an Google Cloud Platform image from the tar.gz file you just uploaded with the following command:

   $ gcloud compute images create \
       "$image_name" \
       --source-uri="gs://${gcloud_bucket}/$image_name.tar.gz" \
       --family "rhel-ai" \
       --guest-os-features=GVNIC

Procedure

1. Log in to your Google Cloud Platform account by running the following command:

   $ gcloud auth login

2. Before launching your Google Cloud Platform instance on the CLI, you need to create several configuration variables for your instance.

3. You need to select the instance profile that you want to use for the deployment. List all the profiles in the desired region by running the following command:

   $ gcloud compute machine-types list --zones=<zone>

   Make a note of your preferred machine type, you will need it for your instance deployment.

4. You can now start creating your Google Cloud Platform instance. Populate environment variables for when you create the instance.

   name=my-rhelai-instance
   zone=us-central1-a
   machine_type=a3-highgpu-8g
   accelerator="type=nvidia-h100-80gb,count=8"
   image=my-custom-rhelai-image
   disk_size=1024
   subnet=default

5. Configure the zone to be used.

   $ gcloud config set compute/zone $zone

6. You can now launch your instance, by running the following command:

   $ gcloud compute instances create \
       ${name} \
       --machine-type ${machine_type} \
       --image $image \
       --zone $zone \
       --subnet $subnet \
       --boot-disk-size ${disk_size} \
       --boot-disk-device-name ${name} \
       --accelerator=$accelerator