Chapter 1. Installation overview


Red Hat Enterprise Linux AI is distributed and installable as a bootable image. This bootable image includes a container that hold various software and tools for RHEL AI. Each image is compiled to support specific hardware vendors. Each RHEL AI image includes:

  • Red Hat Enterprise Linux 9.4: A RHEL version 9.4 operating system (OS) for your machine.
  • The InstructLab container: Contains InstructLab and various other tools required for RHEL AI. This includes:

    • Python version 3.11: A Python 3.11 installation used internally by InstructLab.
    • The InstructLab tools:

      • The InstructLab command line interface (CLI).
      • The LAB enhanced method of synthetic data generation (SDG).
      • The LAB enhanced method of single and multi-phase training.
    • InstructLab with vLLM: A high-input inference and serving engine for Large Language models (LLMs).
    • InstructLab with DeepSpeed: A learning optimization software that speeds up the training and inferencing process.

Red Hat Enterprise Linux AI version 1.1 also includes a sample taxonomy tree with example skills and knowledge that you can download and use for training a model.

For general availability, there are three options for installing and deploying Red Hat Enterprise Linux AI.

After installation with Red Hat Enterprise Linux AI general availability, you can manually download open source Granite LLMs that you can chat and interact with. For more information about downloading these models, see Downloading additional models.

Important

For Red Hat Enterprise Linux AI general availability, Red Hat only provides bootable images compiled to NVIDIA hardware. For more information about supported hardware, see "Red Hat Enterprise Linux AI hardware requirements" in the "Getting Started" documentation.

Red Hat logoGithubRedditYoutubeTwitter

Learn

Try, buy, & sell

Communities

About Red Hat Documentation

We help Red Hat users innovate and achieve their goals with our products and services with content they can trust.

Making open source more inclusive

Red Hat is committed to replacing problematic language in our code, documentation, and web properties. For more details, see the Red Hat Blog.

About Red Hat

We deliver hardened solutions that make it easier for enterprises to work across platforms and environments, from the core datacenter to the network edge.

© 2024 Red Hat, Inc.