Red Hat Summit Red Hat SummitSupportConsoleDevelopersStart a trialContact

Explore popular products

Featured use cases

Explore all products

Discover learning resources

Updating

Red Hat Enterprise Linux AI 1.4

Upgrading your RHEL AI system and models

Red Hat RHEL AI Documentation Team

Abstract

This document provides instructions for updating your RHEL AI instance and updating LLMs

Red Hat Enterprise Linux AI allows you to update your instance so you can use the latest version of RHEL AI and InstructLab.

You can update your instance to use the latest version of RHEL AI and InstructLab

Prerequisites

  • You installed and deployed a Red Hat Enterprise Linux AI instance on one of the supported platforms.
  • You created a Red Hat registry account.
  • You have root user access on your machine.

Procedure

  1. Log into your Red Hat registry account with the podman command: 

    $ sudo podman login registry.redhat.io --username <user-name> --password <user-password> --authfile /etc/ostree/auth.json
    Copied!

    Or you can log in with the skopeo command: 

    $ sudo skopeo login registry.redhat.io --username <user-name> --password <user-password> --authfile /etc/ostree/auth.json
    Copied!

  2. Upgrading to a minor version of Red Hat Enterprise Linux AI

    1. You can upgrade your instance to use the latest version of Red Hat Enterprise Linux AI by using the bootc image for your machines hardware.  

      $ sudo bootc switch registry.redhat.io/rhelai1/bootc-<hardware-vendor>-rhel9:<rhel-ai-version>
      Copied!

      where

      <hardware-vendor>
      Specify the hardare vendor for your accelerators. Valid values include: nvidia, amd, and intel.
      <rhel-ai-version>

      Specify the RHEL AI version you want to upgrade to.

      Example command for machines with NVIDIA accelerators

      $ sudo bootc switch registry.redhat.io/rhelai1/bootc-nvidia-rhel9:1.4
      Copied!

    2. Restart your system by running the following command: 

      $ sudo reboot -n
      Copied!
      Important

      When upgrading to RHEL AI version 1.4, the /etc/skel/.config/containers/storage.conf storage configuration needs to be copied to your <user-home>/.config/containers/storage.conf home directory before re-initializing.

      For example: 

      $ cp /etc/skel/.config/containers/storage.conf <user-home>/.config/containers/storage.con
      Copied!

  3. Upgrading to a z-stream version of Red Hat Enterprise Linux AI

    1. If a z-stream exists, you can upgrade your system to a z-stream version of RHEL AI by running the folllowing command: 

      $ sudo bootc upgrade --apply
      Copied!

  4. It is recommended to re-initialize your environment and configurations after you upgrade to the latest RHEL AI version.

    Warning

    The ilab config init command overrides your existing config.yaml file and sets it to the default configurations per your system hardware. If you customized the config.yaml file, ensure you are familiar with your custom configurations before re-initializing. 

    $ ilab config init
    Copied!

Red Hat Enterprise Linux AI allows you to upgrade LLMs that you locally downloaded to the latest version of the model.

Table 2.1. RHEL AI version 1.4 LLM support
FeatureDescriptionVersion introducedNVIDIAAMD

granite-8b-starter

Granite student model for customizing and fine-tuning

1.3

Generally available

Technology preview

granite-8b-redhat-lab

Granite model for inference serving

1.3

Generally available

Technology preview

granite-8b-lab-v2-preview

Preview of the version 2 8b Granite model for inference serving

1.3

Technology preview

Technology preview

granite-3.1-8b-starter-v1

Version 1 of the Granite 3.1 base model for customizing and fine-tuning

1.4

Generally available

Technology preview

granite-3.1-8b-lab-v1

Version 1 of the Granite 3.1 model for inference serving

1.4

Generally available

Technology preview

You can upgrade your local models to the latest version of the model using the RHEL AI tool set.

Prerequisites

  • You installed the InstructLab tools with the bootable container image.
  • You initialized InstructLab and can use the ilab CLI.
  • You downloaded LLMs on Red Hat Enterprise Linux AI.
  • You created a Red Hat registry account and logged in on your machine.

Procedure

  1. You can upgrade any model by running the following command. 

    $ ilab model download --repository <repository_and_model> --release latest
    Copied!

    where:

    <repository_and_model>
    Specifies the repository location of the model as well as the model. You can access the models from the registry.redhat.io/rhelai1/ repository.
    <release>
    Specifies the version of the model. Set to latest, or a specific version of the model, for the most up to date version of the model.

Verification

  1. You can view all the downloaded models on your system with the following command: 

    $ ilab model list
    Copied!

Legal Notice
Copy link

Copyright © 2025 Red Hat, Inc.
The text of and illustrations in this document are licensed by Red Hat under a Creative Commons Attribution–Share Alike 3.0 Unported license ("CC-BY-SA"). An explanation of CC-BY-SA is available at http://creativecommons.org/licenses/by-sa/3.0/. In accordance with CC-BY-SA, if you distribute this document or an adaptation of it, you must provide the URL for the original version.
Red Hat, as the licensor of this document, waives the right to enforce, and agrees not to assert, Section 4d of CC-BY-SA to the fullest extent permitted by applicable law.
Red Hat, Red Hat Enterprise Linux, the Shadowman logo, the Red Hat logo, JBoss, OpenShift, Fedora, the Infinity logo, and RHCE are trademarks of Red Hat, Inc., registered in the United States and other countries.
Linux® is the registered trademark of Linus Torvalds in the United States and other countries.
Java® is a registered trademark of Oracle and/or its affiliates.
XFS® is a trademark of Silicon Graphics International Corp. or its subsidiaries in the United States and/or other countries.
MySQL® is a registered trademark of MySQL AB in the United States, the European Union and other countries.
Node.js® is an official trademark of Joyent. Red Hat is not formally related to or endorsed by the official Joyent Node.js open source or commercial project.
The OpenStack® Word Mark and OpenStack logo are either registered trademarks/service marks or trademarks/service marks of the OpenStack Foundation, in the United States and other countries and are used with the OpenStack Foundation's permission. We are not affiliated with, endorsed or sponsored by the OpenStack Foundation, or the OpenStack community.
All other trademarks are the property of their respective owners.
Red Hat logoGithubRedditYoutube

About Red Hat Documentation

We help Red Hat users innovate and achieve their goals with our products and services with content they can trust.

Making open source more inclusive

Red Hat is committed to replacing problematic language in our code, documentation, and web properties. For more details, see the Red Hat Blog.

About Red Hat

We deliver hardened solutions that make it easier for enterprises to work across platforms and environments, from the core datacenter to the network edge.

© 2024 Red Hat, Inc.