SupportConsoleDevelopersStart a trialContact

Updating

Red Hat Enterprise Linux AI 1.3

Upgrading your RHEL AI system and models

Red Hat RHEL AI Documentation Team

Abstract

This document provides instructions for updating your RHEL AI instance and updating LLMs

Chapter 1. Updating Red Hat Enterprise Linux AI

Red Hat Enterprise Linux AI allows you to update your instance so you can use the latest version of RHEL AI and InstructLab.

1.1. Updating your RHEL AI instance

You can update your instance to use the latest version of RHEL AI and InstructLab

Prerequisets

  • You installed and deployed a Red Hat Enterprise Linux AI instance on one of the supported platforms.
  • You created a Red Hat registry account.
  • You have root user access on your machine.

Procedure

  1. Log into your Red Hat registry account with the podman command: 

    $ sudo podman login registry.redhat.io --username <user-name> --password <user-password> --authfile /etc/ostree/auth.json

    Or you can log in with the skopeo command: 

    $ sudo skopeo login registry.redhat.io --username <user-name> --password <user-password> --authfile /etc/ostree/auth.json

  2. Upgrading to a minor version of Red Hat Enterprise Linux AI

    1. You can upgrade your instance to use the latest version of Red Hat Enterprise Linux AI by running the following command: 

      $ sudo bootc switch <latest-rhelai-image>

      where

      <path-to-latest-image>

      Specify the latest version of the RHEL AI image.

      Example command

      $ sudo bootc switch registry.redhat.io/rhelai1/bootc-nvidia-rhel9:1.3

    2. Restart your system by running the following command: 

      $ sudo reboot -n

  3. Upgrading to a z-stream version of Red Hat Enterprise Linux AI

    1. If a z-stream exists, you can upgrade your system to a z-stream version of RHEL AI by running the folllowing command: 

      $ sudo bootc upgrade --apply

  4. It is recommended to re-initialize your environment and configurations after you upgrade to the latest RHEL AI version.

    Warning

    The ilab config init command overrides your existing config.yaml file and sets it to the default configurations per your system hardware. If you customized the config.yaml file, ensure you are familiar with your custom configurations before re-initializing. 

    $ ilab config init

Chapter 2. Updating a model

Red Hat Enterprise Linux AI allows you to upgrade LLMs that you locally downloaded to the latest version of the model.

Table 2.1. RHEL AI version 1.3 LLM support
FeatureDescriptionVersion introducedNVIDIAAMD

granite-7b-starter

Granite student model for customizing and fine-tuning

RHEL AI 1.1

Deprecated

Deprecated

granite-7b-redhat-lab

Granite model for inference serving

RHEL AI 1.1

Deprecated

Deprecated

granite-8b-starter

Granite student model for customizing and fine-tuning

RHEL AI 1.3

Generally available

Technology preview

granite-8b-redhat-lab

Granite model for inference serving

RHEL AI 1.3

Generally available

Technology preview

granite-8b-lab-v2-preview

Preview of the version 2 8b Granite model for inference serving

RHEL AI 1.3

Technology preview

Technology preview

2.1. Updating the models

You can upgrade your local models to the latest version of the model using the RHEL AI tool set.

Prerequisites

  • You installed the InstructLab tools with the bootable container image.
  • You initialized InstructLab and can use the ilab CLI.
  • You downloaded LLMs on Red Hat Enterprise Linux AI.
  • You created a Red Hat registry account and logged in on your machine.

Procedure

  1. You can upgrade any model by running the following command. 

    $ ilab model download --repository <repository_and_model> --release latest

    where:

    <repository_and_model>
    Specifies the repository location of the model as well as the model. You can access the models from the registry.redhat.io/rhelai1/ repository.
    <release>
    Specifies the version of the model. Set to latest, or a specific version of the model, for the most up to date version of the model.

Verification

  1. You can view all the downloaded models on your system with the following command: 

    $ ilab model list

Legal Notice

Copyright © 2024 Red Hat, Inc.
The text of and illustrations in this document are licensed by Red Hat under a Creative Commons Attribution–Share Alike 3.0 Unported license ("CC-BY-SA"). An explanation of CC-BY-SA is available at http://creativecommons.org/licenses/by-sa/3.0/. In accordance with CC-BY-SA, if you distribute this document or an adaptation of it, you must provide the URL for the original version.
Red Hat, as the licensor of this document, waives the right to enforce, and agrees not to assert, Section 4d of CC-BY-SA to the fullest extent permitted by applicable law.
Red Hat, Red Hat Enterprise Linux, the Shadowman logo, the Red Hat logo, JBoss, OpenShift, Fedora, the Infinity logo, and RHCE are trademarks of Red Hat, Inc., registered in the United States and other countries.
Linux® is the registered trademark of Linus Torvalds in the United States and other countries.
Java® is a registered trademark of Oracle and/or its affiliates.
XFS® is a trademark of Silicon Graphics International Corp. or its subsidiaries in the United States and/or other countries.
MySQL® is a registered trademark of MySQL AB in the United States, the European Union and other countries.
Node.js® is an official trademark of Joyent. Red Hat is not formally related to or endorsed by the official Joyent Node.js open source or commercial project.
The OpenStack® Word Mark and OpenStack logo are either registered trademarks/service marks or trademarks/service marks of the OpenStack Foundation, in the United States and other countries and are used with the OpenStack Foundation's permission. We are not affiliated with, endorsed or sponsored by the OpenStack Foundation, or the OpenStack community.
All other trademarks are the property of their respective owners.
Red Hat logoGithubRedditYoutubeTwitter

Learn

Try, buy, & sell

Communities

About Red Hat Documentation

We help Red Hat users innovate and achieve their goals with our products and services with content they can trust.

Making open source more inclusive

Red Hat is committed to replacing problematic language in our code, documentation, and web properties. For more details, see the Red Hat Blog.

About Red Hat

We deliver hardened solutions that make it easier for enterprises to work across platforms and environments, from the core datacenter to the network edge.

© 2024 Red Hat, Inc.