Chapter 5. Installing RHEL AI on Google Cloud Platform (GCP)

Procedure

1. Log in to Google Cloud Platform with the following command:

   $ gcloud auth login

   Copy to Clipboard Toggle word wrap

   Example output of the login.

   $ gcloud auth login
   Your browser has been opened to visit:
   
       https://accounts.google.com/o/oauth2/auth?XXXXXXXXXXXXXXXXXXXX
   
   
   You are now logged in as [user@example.com].
   Your current project is [your-project].  You can change this setting by running:
     $ gcloud config set project PROJECT_ID

   Copy to Clipboard Toggle word wrap

2. You need to set up some Google Cloud Platform configurations and create your GCP Storage Container before creating the GCP image.

   1. Configure Google Cloud Platform CLI to use your project.

      $ gcloud_project=your-gcloud-project
      $ gcloud config set project $gcloud_project

      Copy to Clipboard Toggle word wrap

   2. Create an environment variable defining the region where you want to operate.

      $ gcloud_region=us-central1

      Copy to Clipboard Toggle word wrap

   3. Create a Google Cloud Platform Storage Container.

      $ gcloud_bucket=name-for-your-bucket
      $ gsutil mb -l $gcloud_region gs://$gcloud_bucket

      Copy to Clipboard Toggle word wrap
3. Now that your GCP Storage Container is set up, you need to download the GCP tar.gz image from the Red Hat Enterprise Linux AI download page.

4. Unzip the tar.gz file with the following command:

   $ gunzip <downloaded-gcp-gz-image>

   Copy to Clipboard Toggle word wrap

5. Set the name you want to use as the RHEL AI Google Cloud Platform image.

   $ image_name=rhel-ai-1-2

   Copy to Clipboard Toggle word wrap

6. Upload the tar.gz file to the Google Cloud Platform Storage Container by running the following command:

   $ gsutil cp rhelai_gcp.tar.gz "gs://${gcloud_bucket}/$image_name.tar.gz"

   Copy to Clipboard Toggle word wrap

7. Create an Google Cloud Platform image from the tar.gz file you just uploaded with the following command:

   $ gcloud compute images create \
       "$image_name" \
       --source-uri="gs://${gcloud_bucket}/$image_name.tar.gz" \
       --family "rhel-ai" \
       --guest-os-features=GVNIC

   Copy to Clipboard Toggle word wrap

Procedure

1. Log in to your Google Cloud Platform account by running the following command:

   $ gcloud auth login

   Copy to Clipboard Toggle word wrap
2. Before launching your Google Cloud Platform instance on the CLI, you need to create several configuration variables for your instance.

3. You need to select the instance profile that you want to use for the deployment. List all the profiles in the desired region by running the following command:

   $ gcloud compute machine-types list --zones=<zone>

   Copy to Clipboard Toggle word wrap

   Make a note of your preferred machine type, you will need it for your instance deployment.

4. You can now start creating your Google Cloud Platform instance. Populate environment variables for when you create the instance.

   name=my-rhelai-instance
   zone=us-central1-a
   machine_type=a3-highgpu-8g
   accelerator="type=nvidia-h100-80gb,count=8"
   image=my-custom-rhelai-image
   disk_size=1024
   subnet=default

   Copy to Clipboard Toggle word wrap

5. Configure the zone to be used.

   $ gcloud config set compute/zone $zone

   Copy to Clipboard Toggle word wrap

6. You can now launch your instance, by running the following command:

   $ gcloud compute instances create \
       ${name} \
       --machine-type ${machine_type} \
       --image $image \
       --zone $zone \
       --subnet $subnet \
       --boot-disk-size ${disk_size} \
       --boot-disk-device-name ${name} \
       --accelerator=$accelerator

   Copy to Clipboard Toggle word wrap