Ce contenu n'est pas disponible dans la langue sélectionnée.
Chapter 2. Updating a model
Red Hat Enterprise Linux AI allows you to upgrade LLMs that you locally downloaded to the latest version of the model.
| Feature | Description | Version introduced | NVIDIA | AMD |
|---|---|---|---|---|
|
| Granite student model for customizing and fine-tuning | RHEL AI 1.1 | Deprecated | Deprecated |
|
| Granite model for inference serving | RHEL AI 1.1 | Deprecated | Deprecated |
|
| Granite student model for customizing and fine-tuning | RHEL AI 1.3 | Generally available | Technology preview |
|
| Granite model for inference serving | RHEL AI 1.3 | Generally available | Technology preview |
|
| Preview of the version 2 8b Granite model for inference serving | RHEL AI 1.3 | Technology preview | Technology preview |
2.1. Updating the models
You can upgrade your local models to the latest version of the model using the RHEL AI tool set.
Prerequisites
- You installed the InstructLab tools with the bootable container image.
-
You initialized InstructLab and can use the
ilabCLI. - You downloaded LLMs on Red Hat Enterprise Linux AI.
- You created a Red Hat registry account and logged in on your machine.
Procedure
You can upgrade any model by running the following command.
$ ilab model download --repository <repository_and_model> --release latest
where:
- <repository_and_model>
-
Specifies the repository location of the model as well as the model. You can access the models from the
registry.redhat.io/rhelai1/repository. - <release>
-
Specifies the version of the model. Set to
latest, or a specific version of the model, for the most up to date version of the model.
Verification
You can view all the downloaded models on your system with the following command:
$ ilab model list
