Updating your models
Red Hat Enterprise Linux AI 1.1
Upgrading LLM models on RHEL AI
Abstract
This document provides instructions for updating LLMs on RHEL AI
Chapter 1. Updating a model
Red Hat Enterprise Linux AI allows you to upgrade LLMs that you locally downloaded to the latest version of the model.
1.1. Updating the models
You can upgrade your local models to the latest version of the model using the RHEL AI tool set.
Prerequisites
- You installed the InstructLab tools with the bootable container image.
-
You initialized InstructLab and can use the
ilabCLI. - You downloaded LLMs on Red Hat Enterprise Linux AI.
- You created a Red Hat registry account and logged in on your machine.
Procedure
You can upgrade any model by running the following command.
$ ilab model download --repository <repository_and_model> --release latest
where:
- <repository_and_model>
-
Specifies the repository location of the model as well as the model. You can access the models from the
registry.redhat.io/rhelai1/repository. - <release>
-
Specifies the version of the model. Set to
latest, or a specific version of the model, for the most up to date version of the model.
Verification
You can view all the downloaded models on your system with the following command:
$ ilab model list
Legal Notice
Copyright © 2024 Red Hat, Inc.
The text of and illustrations in this document are licensed by Red Hat under a Creative Commons Attribution–Share Alike 3.0 Unported license ("CC-BY-SA"). An explanation of CC-BY-SA is available at http://creativecommons.org/licenses/by-sa/3.0/. In accordance with CC-BY-SA, if you distribute this document or an adaptation of it, you must provide the URL for the original version.
Red Hat, as the licensor of this document, waives the right to enforce, and agrees not to assert, Section 4d of CC-BY-SA to the fullest extent permitted by applicable law.
Red Hat, Red Hat Enterprise Linux, the Shadowman logo, the Red Hat logo, JBoss, OpenShift, Fedora, the Infinity logo, and RHCE are trademarks of Red Hat, Inc., registered in the United States and other countries.
Linux® is the registered trademark of Linus Torvalds in the United States and other countries.
Java® is a registered trademark of Oracle and/or its affiliates.
XFS® is a trademark of Silicon Graphics International Corp. or its subsidiaries in the United States and/or other countries.
MySQL® is a registered trademark of MySQL AB in the United States, the European Union and other countries.
Node.js® is an official trademark of Joyent. Red Hat is not formally related to or endorsed by the official Joyent Node.js open source or commercial project.
The OpenStack® Word Mark and OpenStack logo are either registered trademarks/service marks or trademarks/service marks of the OpenStack Foundation, in the United States and other countries and are used with the OpenStack Foundation's permission. We are not affiliated with, endorsed or sponsored by the OpenStack Foundation, or the OpenStack community.
All other trademarks are the property of their respective owners.
