CLI reference
RHEL AI command line interface (CLI) reference
Abstract
Chapter 1. Red Hat Enterprise Linux AI command line interface reference Copy linkLink copied to clipboard!
This reference provides descriptions and examples for the Red Hat Enterprise Linux AI CLI (ilab) commands.
1.1. Red Hat Enterprise Linux AI CLI commands Copy linkLink copied to clipboard!
1.1.1. ilab config Copy linkLink copied to clipboard!
Command Group for Interacting with the configuration of InstructLab
Example usage
# Prints the usable commands in the config group
ilab config
1.1.1.1. ilab config init Copy linkLink copied to clipboard!
Initializes environment for InstructLab
Example usage
# Set up the InstructLab environment
ilab config init
1.1.1.2. ilab config show Copy linkLink copied to clipboard!
Displays current state of the config file stored at ~/.config/instructlab/config.yaml
Example usage
# Shows the `config.yaml` file on your system
ilab config show
1.1.1.3. ilab config edit Copy linkLink copied to clipboard!
Allows you to edit the config stored at ~/.config/config.yaml
Example usage
# Opens a vim shell where you can edit your config file
ilab config edit
1.1.2. ilab data Copy linkLink copied to clipboard!
Command Group for Interacting with the data generated by InstructLab
Example usage
# Prints the usable commands in the data group
ilab data
1.1.2.1. ilab data generate Copy linkLink copied to clipboard!
Runs the synthetic data generation (SDG) process for InstructLab
Example usage
# Runs the SDG process on the default model, the default model is specified in the `~/.config/config.yaml`
ilab data generate
# Runs the SDG process on a selected model
ilab data generate --model <model-name>
# Runs the SDG process on the customized taxonomy path
ilab data generate --taxonomy-path <path-to-taxonomy>
# Edits the `config.yaml` to use a specified number of GPUs in SDG
ilab data generate --gpus <num-gpus>
1.1.2.2. ilab data list Copy linkLink copied to clipboard!
Displays every dataset in the datasets directory, ` ~/.local/instructlab/datasets` , on your machine
Example usage
# List every dataset in the datasets directory
ilab data list
1.1.3. ilab model Copy linkLink copied to clipboard!
Command Group for Interacting with the models in InstructLab
Example usage
# Prints the usable commands in the model group
ilab model
1.1.3.1. ilab model chat Copy linkLink copied to clipboard!
Run a chat using the modified model
Example usage
# Creates a virtual environment to chat with the model
ilab model chat
# Creates a virtual environment to chat with a specified model
ilab model chat --model <model-name>
1.1.3.2. ilab model download Copy linkLink copied to clipboard!
Downloads the model(s)
Example usage
# Downloads the default models
ilab model download
# Downloads the models from a specific repository
ilab model download --repository <name-of-repository>
1.1.3.3. ilab model evaluate Copy linkLink copied to clipboard!
Runs the evaluation process on the model
Example usage
# Runs the evaluation process on the MMLU benchmark
ilab model evaluate --benchmark mmlu
# Runs the evaluation process on the MT_BENCH benchmark
ilab model evaluate --benchmark mt_bench
# Runs the evaluation process on the MMLU_BRANCH benchmark
ilab model evaluate --benchmark mmlu_branch
# Runs the evaluation process on the MT_BENCH_BRANCH benchmark
ilab model evaluate --benchmark mt_bench_branch
1.1.3.4. ilab model list Copy linkLink copied to clipboard!
Lists all the models installed on your system
Example usage
* List all the installed models
ilab model list
1.1.3.5. ilab model train Copy linkLink copied to clipboard!
Runs the training process on the model
Example usage
# Runs the training process on the default model from the config.yaml
ilab model train
# Runs the training process on a specified model
ilab model train --model-name <name-of-model>
1.1.3.6. ilab model serve Copy linkLink copied to clipboard!
Serves the model on an endpoint
Example usage
# Serves the default model to the server
ilab model serve
# Serves the specified model to the server
ilab model serve --model-path <path-to-model>
# Serves the default model using a specified number of GPUs
ilab model serve --gpus <num-gpus>
1.1.4. ilab system Copy linkLink copied to clipboard!
Command group for all system-related commands
Example usage
# Prints the usable commands in the system group
ilab system
1.1.4.1. ilab system info Copy linkLink copied to clipboard!
Displays the hardware specifications of your system
Example usage
#Prints the hardware specifications of your machine
ilab system info
1.1.5. ilab taxonomy Copy linkLink copied to clipboard!
Command Group for Interacting with the taxonomy path of InstructLab
Example usage
# Prints the usable commands in the taxonomy group
ilab taxonomy
1.1.5.1. ilab taxonomy diff Copy linkLink copied to clipboard!
Lists taxonomy files that you changed and verifies that the taxonomy is valid
Example usage
# Prints the taxonomy files you changed and verifies that the taxonomy is valid
ilab taxonomy diff
# Prints the taxonomy files in a specified path and verifies that the taxonomy is valid
ilab taxonomy diff --taxonomy-path <path-to-taxonomy>