Ce contenu n'est pas disponible dans la langue sélectionnée.

Chapter 3. Validated model support matrix


You can use the model support matrix to verify that a model is compatible with your Red Hat AI Inference, Red Hat OpenShift AI, and vLLM version combination before deploying it for inference serving. The matrix lists all validated and enabled models with their minimum platform version requirements and modelcar container image paths.

For more information, see Red Hat AI models on Hugging Face.

Note

Verify that your deployed Red Hat AI Inference, Red Hat OpenShift AI, and vLLM versions meet or exceed the minimum versions listed for your target model. For an explanation of the Validated and Enabled status values, see Model support levels.

Note

Hugging Face links require internet access. If you are working in a disconnected environment, use the modelcar container image paths with your mirrored registry. For more information, see Deploying the standalone Red Hat AI Inference container in a disconnected environment.

Expand
Table 3.1. Red Hat AI Model support matrix
ModelModelcarStatusMin. vLLM versionMin. RHAII versionMin. RHOAI versionMin. vRAM (GB)Supported GPUsMigration guidance

RedHatAI/granite-3.1-8b-instruct

registry.redhat.io/rhelai1/modelcar-granite-3-1-8b-instruct:1.5

Validated

v0.8.4

3

2.21

19 GB

1XA100-40, 1XA100-80, 1XH100, 1XH200, 1XL4, 2XA100-40, 2XA100-80, 2XH100, 2XL4, 4XA100-40, 4XA100-80, 4XH100, 4XL4, 8XA100-40, 8XA100-80

n/a

RedHatAI/granite-4.0-h-tiny-FP8-dynamic

registry.redhat.io/rhai/modelcar-granite-4-0-h-tiny-fp8-dynamic:3.0

Validated

v0.13.0

3.3.0

3.3.0

9 GB

1XB200, 1XH100, 1XH200, 1XL4

n/a

RedHatAI/Llama-3.1-8B-Instruct

registry.redhat.io/rhelai1/modelcar-llama-3-1-8b-instruct:1.5

Validated

v0.8.4

3

2.21

19 GB

1XA100-40, 1XA100-80, 1XH100, 1XH200, 1XL4, 2XA100-40, 2XA100-80, 2XH100, 2XL4, 4XA100-40, 4XA100-80, 4XH100, 4XL4, 8XA100-40, 8XA100-80

n/a

RedHatAI/Llama-3.3-70B-Instruct

registry.redhat.io/rhelai1/modelcar-llama-3-3-70b-instruct:1.5

Validated

v0.8.4

3

2.21

163 GB

2XH200, 4XA100-80, 4XH100, 8XA100-40, 8XH100

n/a

RedHatAI/Llama-4-Maverick-17B-128E-Instruct

registry.redhat.io/rhelai1/modelcar-llama-4-maverick-17b-128e-instruct:1.5

Validated

v0.8.4

3

2.21

924 GB

8XH200

n/a

RedHatAI/Llama-4-Maverick-17B-128E-Instruct-FP8

registry.redhat.io/rhelai1/modelcar-llama-4-maverick-17b-128e-instruct-fp8:1.5

Validated

v0.8.4

3

2.21

480 GB

4XH200, 8XH100

n/a

RedHatAI/Llama-4-Scout-17B-16E-Instruct

registry.redhat.io/rhelai1/modelcar-llama-4-scout-17b-16e-instruct:1.5

Validated

v0.8.4

3

2.21

250 GB

4XA100-80, 4XH100, 4XH200, 8XH100

n/a

RedHatAI/phi-4

registry.redhat.io/rhelai1/modelcar-phi-4:1.5

Validated

v0.8.4

3

2.21

34 GB

1XA100-40, 1XA100-80, 1XH100, 1XH200, 2XA100-40, 2XA100-80, 2XH100, 2XL4

n/a

RedHatAI/Devstral-Small-2-24B-Instruct-2512

registry.redhat.io/rhai/modelcar-devstral-small-2-24b-instruct-2512:3.0

Validated

v0.14.1

3.4.0-ea.1

3.4.0-ea.1

30 GB

1XA100-80, 1XB200, 1XH100, 1XH200, 2XA100-80, 2XB200, 2XH100, 2XH200, 4XA100-80, 4XB200, 4XH100, 4XH200, 4XL4, 8XA100-80, 8XB200, 8XH100, 8XH200, 8XL4

n/a

RedHatAI/Ministral-3-3B-Instruct-2512

registry.redhat.io/rhai/modelcar-ministral-3-3b-instruct-2512:3.0

Validated

v0.14.1

3.4.0-ea.1

3.4.0-ea.1

6 GB

1XA100-80, 1XB200, 1XH100, 1XH200, 1XL4, 2XA100-80, 2XB200, 2XH100, 2XH200, 2XL4, 4XA100-80, 4XB200, 4XH100, 4XH200, 4XL4, 8XA100-80, 8XB200, 8XH100, 8XH200, 8XL4

n/a

RedHatAI/Mistral-Large-3-675B-Instruct-2512

registry.redhat.io/rhai/modelcar-mistral-large-3-675b-instruct-2512:3.0

Validated

v0.11.2

3.2.5

3.2

784 GB

8XB200, 8XH200

n/a

RedHatAI/Mistral-Large-3-675B-Instruct-2512-NVFP4

registry.redhat.io/rhai/modelcar-mistral-large-3-675b-instruct-2512-nvfp4:3.0

Validated

v0.11.2

3.2.5

3.2

464 GB

4XB200, 4XH200, 8XA100-80, 8XB200, 8XH100, 8XH200

n/a

RedHatAI/Mistral-Small-24B-Instruct-2501

registry.redhat.io/rhelai1/modelcar-mistral-small-24b-instruct-2501:1.5

Validated

v0.8.4

3

2.21

55 GB

1XA100-80, 1XH100, 2XA100-40, 2XA100-80, 2XH100, 4XA100-40, 4XA100-80, 4XH100, 4XL4, 8XA100-40, 8XH100

n/a

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503

registry.redhat.io/rhelai1/modelcar-mistral-small-3-1-24b-instruct-2503:1.5

Validated

v0.8.4

3

2.21

56 GB

1XA100-80, 1XH100, 1XH200, 2XA100-40, 2XA100-80, 2XH100, 4XA100-40, 4XA100-80, 4XH100, 4XL4, 8XA100-40, 8XH100

n/a

RedHatAI/Mixtral-8x7B-Instruct-v0.1

registry.redhat.io/rhelai1/modelcar-mixtral-8x7b-instruct-v0-1:1.4

Validated

v0.8.4

3

2.21

108 GB

1XH200, 2XA100-80, 2XH100, 4XA100-40, 4XA100-80, 4XH100, 8XA100-40, 8XH100, 8XL4

n/a

RedHatAI/NVIDIA-Nemotron-Nano-9B-v2-quantized.w4a16

registry.redhat.io/rhelai1/modelcar-nvidia-nemotron-nano-9b-v2-quantized-w4a16:1.5

Validated

v0.11.0

3.2.3, 3.2.4

3

8 GB

1XH100

n/a

RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF

registry.redhat.io/rhelai1/modelcar-llama-3-1-nemotron-70b-instruct-hf:1.5

Validated

v0.8.4

3

2.21

163 GB

2XH200, 4XA100-80, 4XH100, 8XA100-40

n/a

RedHatAI/NVIDIA-Nemotron-3-Nano-30B-A3B-FP8

registry.redhat.io/rhai/modelcar-nvidia-nemotron-3-nano-30b-a3b-fp8:3.0

Validated

v0.11.2

3.2.5

3.2

38 GB

1XB200, 1XH100, 1XH200, 2XB200, 2XH100, 2XH200, 4XB200, 4XH100, 4XH200, 8XB200, 8XH100, 8XH200

n/a

RedHatAI/NVIDIA-Nemotron-3-Super-120B-A12B-BF16

registry.redhat.io/rhai/modelcar-nvidia-nemotron-3-super-120b-a12b-bf16:3.0

Validated

v0.17.1

3.4.0-ea.2

3.4.0-ea.2

285 GB

2XH200, 4XA100-80, 4XH100, 4XH200, 8XA100-80, 8XH100, 8XH200

n/a

RedHatAI/NVIDIA-Nemotron-3-Super-120B-A12B-FP8

registry.redhat.io/rhai/modelcar-nvidia-nemotron-3-super-120b-a12b-fp8:3.0

Validated

v0.17.1

3.4.0-ea.2

3.4.0-ea.2

148 GB

1XH200, 2XH100, 2XH200, 4XH100, 4XH200, 8XH100, 8XH200

n/a

RedHatAI/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4

registry.redhat.io/rhai/modelcar-nvidia-nemotron-3-super-120b-a12b-nvfp4:3.0

Validated

v0.17.1

3.4.0-ea.2

3.4.0-ea.2

93 GB

1XH200, 2XH100, 2XH200

n/a

RedHatAI/gpt-oss-120b

registry.redhat.io/rhelai1/modelcar-gpt-oss-120b:1.5

Validated

v0.10.1.1

3.2.2

2.25

76 GB

1XB200, 1XH100, 1XH200, 2XB200, 2XH100, 2XH200, 4XA100-40, 4XB200, 4XH100, 4XH200, 4XL4, 8XA100-40, 8XB200, 8XH100, 8XH200, 8XL4

n/a

RedHatAI/gpt-oss-20b

registry.redhat.io/rhelai1/modelcar-gpt-oss-20b:1.5

Validated

v0.10.1.1

3.2.2

2.25

16 GB

1XA100-40, 1XB200, 1XH100, 1XH200, 1XL4, 2XA100-40, 2XB200, 2XH100, 2XH200, 2XL4, 4XA100-40, 4XB200, 4XH100, 4XH200, 4XL4, 8XA100-40, 8XB200, 8XH100, 8XH200, 8XL4

n/a

RedHatAI/Qwen2.5-7B-Instruct

registry.redhat.io/rhelai1/modelcar-qwen2-5-7b-instruct:1.5

Validated

v0.8.4

3

2.21

18 GB

1XA100-40, 1XA100-80, 1XH100, 1XH200, 1XL4, 2XA100-40, 2XA100-80, 2XH100, 2XL4, 4XA100-40, 4XA100-80, 4XH100

n/a

Qwen/Qwen3-8B-FP8

registry.redhat.io/rhelai1/modelcar-qwen3-8b-fp8:1.5

Validated

v0.10.0

3.2.1

2.24

11 GB

1XA100-40, 1XH100, 1XL4, 2XH100

n/a

RedHatAI/Apertus-8B-Instruct-2509-FP8-dynamic

registry.redhat.io/rhai/modelcar-apertus-8b-instruct-2509-fp8-dynamic:3.0

Validated

v0.11.2

3.2.5

3.2

11 GB

1XA100-80, 1XB200, 1XH100, 1XH200, 2XA100-80, 2XB200, 2XH100, 2XH200, 4XA100-80, 4XB200, 4XH100, 4XH200, 8XA100-80, 8XB200, 8XH100, 8XH200

n/a

RedHatAI/DeepSeek-R1-0528-quantized.w4a16

registry.redhat.io/rhelai1/modelcar-deepseek-r1-0528-quantized-w4a16:1.5

Validated

v0.10.0

3.2.1

2.24

428 GB

4XB200, 4XH200, 8XB200, 8XH100, 8XH200

n/a

RedHatAI/gemma-3n-E4B-it-FP8-dynamic

registry.redhat.io/rhelai1/modelcar-gemma-3n-e4b-it-fp8-dynamic:1.5

Validated

v0.10.0

3.2.1

2.24

14 GB

1XA100-40, 1XH100, 1XH200, 1XL4, 2XA100-40, 2XH100, 2XH200, 2XL4, 4XA100-40, 4XH100, 4XH200, 4XL4, 8XA100-40, 8XH100, 8XH200, 8XL4

n/a

RedHatAI/granite-3.1-8b-instruct-fp8-dynamic

registry.redhat.io/rhelai1/modelcar-granite-3-1-8b-instruct-fp8-dynamic:1.5

Validated

v0.8.4

3

2.21

11 GB

1XH200

n/a

RedHatAI/granite-3.1-8b-instruct-quantized.w4a16

registry.redhat.io/rhelai1/modelcar-granite-3-1-8b-instruct-quantized-w4a16:1.5

Validated

v0.8.4

3

2.21

6 GB

1XH200

n/a

RedHatAI/granite-4.0-h-small-FP8-dynamic

registry.redhat.io/rhai/modelcar-granite-4-0-h-small-fp8-dynamic:3.0

Validated

v0.13.0

3.3.0

3.3.0

38 GB

1XA100-80, 1XB200, 1XH100, 1XH200

n/a

RedHatAI/Kimi-K2-Instruct-quantized.w4a16

registry.redhat.io/rhelai1/modelcar-kimi-k2-instruct-quantized-w4a16:1.5

Validated

v0.10.0

3.2.1

2.24

629 GB

4XB200, 8XB200, 8XH200

n/a

RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-dynamic

registry.redhat.io/rhelai1/modelcar-llama-3-1-nemotron-70b-instruct-hf-fp8-dynamic:1.5

Validated

v0.8.4

3

2.21

84 GB

1XH200, 2XA100-80, 2XH100, 4XA100-40, 4XA100-80, 4XH100, 8XA100-40, 8XH100

n/a

RedHatAI/Llama-3.3-70B-Instruct-FP8-dynamic

registry.redhat.io/rhelai1/modelcar-llama-3-3-70b-instruct-fp8-dynamic:1.5

Validated

v0.8.4

3

2.21

84 GB

1XH200, 2XH100, 4XA100-40, 4XA100-80, 4XH100, 8XA100-40, 8XA100-80, 8XH100

n/a

RedHatAI/Llama-3.3-70B-Instruct-quantized.w4a16

registry.redhat.io/rhelai1/modelcar-llama-3-3-70b-instruct-quantized-w4a16:1.5

Validated

v0.8.4

3

2.21

46 GB

1XH100, 2XH100, 4XA100-40, 4XH100, 8XA100-40, 8XH100

n/a

RedHatAI/Llama-3.3-70B-Instruct-quantized.w8a8

registry.redhat.io/rhelai1/modelcar-llama-3-3-70b-instruct-quantized-w8a8:1.5

Validated

v0.8.4

3

2.21

84 GB

2XH100, 4XA100-40, 4XA100-80, 4XH100, 8XA100-40, 8XH100

n/a

RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-dynamic

registry.redhat.io/rhelai1/modelcar-llama-4-scout-17b-16e-instruct-fp8-dynamic:1.5

Validated

v0.8.4

3

2.21

132 GB

2XH100, 2XH200, 4XH100, 8XH100, 8XL4

n/a

RedHatAI/Llama-4-Scout-17B-16E-Instruct-quantized.w4a16

registry.redhat.io/rhelai1/modelcar-llama-4-scout-17b-16e-instruct-quantized-w4a16:1.5

Validated

v0.8.4

3

2.21

75 GB

2XH100, 2XH200, 4XA100-40, 4XH100, 8XA100-40, 8XH100

n/a

RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic

registry.redhat.io/rhelai1/modelcar-llama-3-1-8b-instruct-fp8-dynamic:1.5

Validated

v0.8.4

3

2.21

11 GB

1XH200

n/a

RedHatAI/MiniMax-M2.5

registry.redhat.io/rhai/modelcar-minimax-m2-5:3.0

Validated

v0.14.1

3.4.0-ea.1

3.4.0-ea.1

265 GB

2XB200, 4XA100-80, 4XB200, 4XH100, 4XH200

n/a

RedHatAI/Ministral-3-14B-Instruct-2512

registry.redhat.io/rhai/modelcar-ministral-3-14b-instruct-2512:3.0

Validated

v0.13.0

3.3.0

3.3.0

19 GB

1XA100-80, 1XB200, 1XH100, 1XH200, 1XL4, 2XA100-80, 2XB200, 2XH100, 2XH200, 2XL4, 4XA100-80, 4XB200, 4XH100, 4XH200, 4XL4, 8XA100-80, 8XB200, 8XH100, 8XH200, 8XL4

n/a

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-FP8-dynamic

registry.redhat.io/rhelai1/modelcar-mistral-small-3-1-24b-instruct-2503-fp8-dynamic:1.5

Validated

v0.8.4

3

2.21

30 GB

1XA100-80, 1XH100, 1XH200, 2XA100-40, 2XA100-80, 2XH100, 2XL4, 4XA100-40, 4XA100-80, 4XH100, 4XL4, 8XA100-40, 8XH100

n/a

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16

registry.redhat.io/rhelai1/modelcar-mistral-small-3-1-24b-instruct-2503-quantized-w4a16:1.5

Validated

v0.8.4

3

2.21

18 GB

1XA100-40, 1XA100-80, 1XH100, 1XH200, 2XA100-40, 2XA100-80, 2XH100, 4XA100-40, 4XA100-80, 4XH100, 8XA100-40, 8XH100

n/a

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w8a8

registry.redhat.io/rhelai1/modelcar-mistral-small-3-1-24b-instruct-2503-quantized-w8a8:1.5

Validated

v0.8.4

3

2.21

30 GB

1XA100-40, 1XA100-80, 1XH100, 1XH200, 2XA100-40, 2XA100-80, 2XH100, 2XL4, 4XA100-40, 4XA100-80, 4XH100, 4XL4, 8XA100-40, 8XA100-80, 8XH100

n/a

RedHatAI/NVIDIA-Nemotron-Nano-9B-v2-FP8-dynamic

registry.redhat.io/rhelai1/modelcar-nvidia-nemotron-nano-9b-v2-fp8-dynamic:1.5

Validated

v0.10.1.1

3.2.2

2.25

12 GB

1XA100-40, 1XB200, 1XH100, 1XH200

n/a

RedHatAI/phi-4-FP8-dynamic

registry.redhat.io/rhelai1/modelcar-phi-4-fp8-dynamic:1.5

Validated

v0.8.4

3

2.21

19 GB

1XA100-40, 1XA100-80, 1XH100, 1XH200, 2XA100-40, 2XA100-80, 2XH100, 2XL4

n/a

RedHatAI/Phi-4-mini-instruct-FP8-dynamic

registry.redhat.io/rhelai1/modelcar-phi-4-mini-instruct-fp8-dynamic:1.5

Validated

v0.14.1

3.4.0-ea.1

3.4.0-ea.1

7 GB

1XA100-80, 1XB200, 1XH100, 1XH200, 1XL4, 2XA100-80, 2XB200, 2XH100, 2XH200, 2XL4, 4XA100-80, 4XB200, 4XH100, 4XH200, 4XL4, 8XA100-80, 8XH100, 8XH200, 8XL4

n/a

RedHatAI/phi-4-quantized.w4a16

registry.redhat.io/rhelai1/modelcar-phi-4-quantized-w4a16:1.5

Validated

v0.8.4

3

2.21

11 GB

1XA100-40, 1XA100-80, 1XH100, 2XA100-40, 2XA100-80, 2XH100, 2XL4

n/a

RedHatAI/phi-4-quantized.w8a8

registry.redhat.io/rhelai1/modelcar-phi-4-quantized-w8a8:1.5

Validated

v0.8.4

3

2.21

19 GB

1XA100-40, 1XA100-80, 1XH100, 2XA100-40, 2XA100-80, 2XH100

n/a

RedHatAI/Phi-4-reasoning-FP8-dynamic

registry.redhat.io/rhai/modelcar-phi-4-reasoning-fp8-dynamic:3.0

Validated

v0.13.0

3.3.0

3.3.0

19 GB

1XA100-80, 1XB200, 1XH100, 1XH200, 1XL4, 2XA100-40, 2XA100-80, 2XB200, 2XH100, 2XH200, 2XL4

n/a

RedHatAI/Qwen2.5-7B-Instruct-FP8-dynamic

registry.redhat.io/rhelai1/modelcar-qwen2-5-7b-instruct-fp8-dynamic:1.5

Validated

v0.8.4

3

2.21

11 GB

1XA100-40, 1XA100-80, 1XH100, 1XH200, 1XL4, 2XA100-40, 2XA100-80, 2XH100, 2XL4, 4XA100-40, 4XA100-80, 4XH100

n/a

RedHatAI/Qwen2.5-7B-Instruct-quantized.w4a16

registry.redhat.io/rhelai1/modelcar-qwen2-5-7b-instruct-quantized-w4a16:1.5

Validated

v0.8.4

3

2.21

7 GB

1XA100-40, 1XA100-80, 1XH100, 1XL4, 2XA100-40, 2XH100, 4XA100-40, 4XH100, 4XL4

n/a

RedHatAI/Qwen2.5-7B-Instruct-quantized.w8a8

registry.redhat.io/rhelai1/modelcar-qwen2-5-7b-instruct-quantized-w8a8:1.5

Validated

v0.8.4

3

2.21

11 GB

1XA100-40, 1XA100-80, 1XH100, 1XL4, 2XA100-40, 2XA100-80, 2XH100, 2XL4, 4XA100-40, 4XH100, 4XL4

n/a

RedHatAI/Qwen3.5-122B-A10B-FP8-dynamic

registry.redhat.io/rhai/modelcar-qwen3-5-122b-a10b-fp8-dynamic:3.0

Validated

v0.17.1

3.4.0-ea.2

3.4.0-ea.2

148 GB

2XA100-80, 2XH100, 4XA100-80, 4XH200, 8XA100-80, 8XH100

n/a

RedHatAI/Qwen3.5-35B-A3B-FP8-dynamic

registry.redhat.io/rhai/modelcar-qwen3-5-35b-a3b-fp8-dynamic:3.0

Validated

v0.17.1

3.4.0-ea.2

3.4.0-ea.2

44 GB

1XA100-80, 1XH100, 1XH200, 2XA100-80, 2XH100, 2XH200, 4XA100-80, 4XH100, 4XH200, 8XA100-80, 8XH100, 8XH200

n/a

RedHatAI/Qwen3.5-397B-A17B-FP8-dynamic

registry.redhat.io/rhai/modelcar-qwen3-5-397b-a17b-fp8-dynamic:3.0

Validated

v0.17.1

3.4.0-ea.2

3.4.0-ea.2

466 GB

4XH200, 8XA100-80, 8XH100

n/a

RedHatAI/Qwen3-8B-FP8-dynamic

registry.redhat.io/rhelai1/modelcar-qwen3-8b-fp8-dynamic:1.5

Validated

v0.10.0

3.2.1

2.24

11 GB

1XA100-40, 1XH100, 1XH200, 1XL4, 2XA100-40, 2XH100, 2XH200, 2XL4, 4XA100-40, 4XH100, 4XH200, 4XL4, 8XA100-40, 8XH100, 8XH200, 8XL4

n/a

RedHatAI/Qwen3-Coder-480B-A35B-Instruct-FP8

registry.redhat.io/rhelai1/modelcar-qwen3-coder-480b-a35b-instruct-fp8:1.5

Validated

v0.10.1.1

3.2.2

2.25

555 GB

4XB200, 4XH200

n/a

RedHatAI/Qwen3-Coder-Next-NVFP4

registry.redhat.io/rhai/modelcar-qwen3-coder-next-nvfp4:3.0

Validated

v0.14.1

3.4.0-ea.1

3.4.0-ea.1

55 GB

1XB200, 1XH100, 1XH200, 2XB200, 2XH100, 2XH200, 4XB200, 4XH100, 4XH200, 8XB200, 8XH100, 8XH200

n/a

RedHatAI/Qwen3-Next-80B-A3B-Instruct-FP8

registry.redhat.io/rhai/modelcar-qwen3-next-80b-a3b-instruct-fp8:3.0

Validated

v0.13.0

3.3.0

3.3.0

95 GB

1XB200, 2XA100-80, 2XB200, 2XH200, 4XA100-80, 4XH200

n/a

RedHatAI/Qwen3-Next-80B-A3B-Instruct-quantized.w4a16

registry.redhat.io/rhai/modelcar-qwen3-next-80b-a3b-instruct-quantized-w4a16:3.0

Validated

v0.13.0

3.3.0

3.3.0

51 GB

1XA100-80, 1XB200, 1XH100, 1XH200, 2XA100-80, 2XB200, 2XH100, 2XH200, 4XA100-80, 4XB200, 4XH100, 4XH200

n/a

RedHatAI/Qwen3-VL-235B-A22B-Instruct-NVFP4

registry.redhat.io/rhai/modelcar-qwen3-vl-235b-a22b-instruct-nvfp4:3.0

Validated

v0.13.0

3.3.0

3.3.0

156 GB

1XB200, 2XA100-80, 2XB200, 2XH100, 2XH200, 4XA100-80, 4XB200, 4XH100, 4XH200, 8XA100-80, 8XB200, 8XH100, 8XH200

n/a

RedHatAI/sarvam-105b-FP8-Dynamic

registry.redhat.io/rhai/modelcar-sarvam-105b-fp8-dynamic:3.0

Validated

v0.18.0

3.4.0

3.4.0

130 GB

1XH200, 2XH200, 4XH100, 4XH200, 8XH100, 8XH200

n/a

RedHatAI/sarvam-30b-FP8-Dynamic

registry.redhat.io/rhai/modelcar-sarvam-30b-fp8-dynamic:3.0

Validated

v0.18.0

3.4.0

3.4.0

45 GB

1XA100-80, 1XH100, 1XH200, 2XA100-80, 2XH100, 2XH200, 4XA100-80, 4XH100, 4XH200, 8XA100-80, 8XH100, 8XH200

n/a

RedHatAI/SmolLM3-3B-FP8-dynamic

registry.redhat.io/rhelai1/modelcar-smollm3-3b-fp8-dynamic:1.5

Validated

v0.10.1.1

3.2.2

2.25

5 GB

1XA100-40, 1XB200, 1XH100, 1XH200, 1XL4, 2XA100-40, 2XB200, 2XH100, 2XH200, 2XL4, 4XA100-40, 4XB200, 4XH100, 4XH200, 4XL4

n/a

RedHatAI/gpt-oss-120b-essential

registry.redhat.io/rhai/modelcar-gpt-oss-120b-essential:3.0

Validated

v0.10.1.1

3.2.2

2.25

76 GB

1XB200, 1XH100, 1XH200, 2XB200, 2XH100, 2XH200, 4XA100-40, 4XB200, 4XH100, 4XH200, 4XL4, 8XA100-40, 8XB200, 8XH100, 8XH200, 8XL4

n/a

RedHatAI/gpt-oss-20b-essential

registry.redhat.io/rhai/modelcar-gpt-oss-20b-essential:3.0

Validated

v0.10.1.1

3.2.2

2.25

16 GB

1XA100-40, 1XB200, 1XH100, 1XH200, 1XL4, 2XA100-40, 2XB200, 2XH100, 2XH200, 2XL4, 4XA100-40, 4XB200, 4XH100, 4XH200, 4XL4, 8XA100-40, 8XB200, 8XH100, 8XH200, 8XL4

n/a

google/gemma-3-1b-it

registry.redhat.io/rhai/modelcar-gemma-3-1b-it:3.0

Enabled

v0.11.2

3.2.5

3.2

3 GB

1XH200

n/a

google/gemma-3-27b-it

registry.redhat.io/rhai/modelcar-gemma-3-27b-it:3.0

Enabled

v0.11.2

3.2.5

3.2

64 GB

1XH200

n/a

ibm-granite/granite-guardian-3.2-5b

registry.redhat.io/rhai/modelcar-granite-guardian-3-2-5b:3.0

Enabled

v0.11.2

3.2.5

3.2

14 GB

1XH200

n/a

meta-llama/Llama-2-7b-chat-hf

registry.redhat.io/rhai/modelcar-llama-2-7b-chat-hf:3.0

Enabled

v0.11.2

3.2.5

3.2

16 GB

1XH200

n/a

RedHatAI/Foundation-Sec-8B-Instruct

registry.redhat.io/rhai/modelcar-foundation-sec-8b-instruct:3.0

Enabled

v0.13.0

3.3.0

3.3.0

19 GB

1XH200

n/a

RedHatAI/gemma-3-12b-it

registry.redhat.io/rhai/modelcar-gemma-3-12b-it:3.0

Enabled

v0.11.2

3.2.5

3.2

29 GB

1XH200

n/a

RedHatAI/gemma-4-26B-A4B-it-FP8-Dynamic

registry.redhat.io/rhai/modelcar-gemma-4-26b-a4b-it-fp8-dynamic:3.0

Enabled

v0.18.0

3.4.0

3.4.0

33 GB

1XH200

n/a

RedHatAI/gemma-4-31B-it-FP8-Dynamic

registry.redhat.io/rhai/modelcar-gemma-4-31b-it-fp8-dynamic:3.0

Enabled

v0.18.0

3.4.0

3.4.0

39 GB

1XH200

n/a

RedHatAI/Llama-Guard-4-12B

registry.redhat.io/rhai/modelcar-llama-guard-4-12b:3.0

Enabled

v0.11.2

3.2.5

3.2

28 GB

1XH200

n/a

RedHatAI/Phi-4-reasoning

registry.redhat.io/rhai/modelcar-phi-4-reasoning:3.0

Enabled

v0.11.2

3.2.5

3.2

34 GB

1XH200

n/a

RedHatAI/Qwen3-Embedding-8B

registry.redhat.io/rhelai1/modelcar-qwen3-embedding-8b:1.5

Enabled

v0.11.2

3.2.5

3.2

17 GB

1XL4

n/a

RedHatAI/granite-embedding-english-r2

registry.redhat.io/rhai/modelcar-granite-embedding-english-r2:3.0

Enabled

v0.11.2

3.2.5

3.2

1 GB

1XL4

n/a

RedHatAI/all-MiniLM-L6-v2

registry.redhat.io/rhai/modelcar-all-minilm-l6-v2:3.0

Enabled

v0.11.2

3.2.5

3.2

1 GB

1XL4

n/a

RedHatAI/nomic-embed-text-v1.5

registry.redhat.io/rhelai1/modelcar-nomic-embed-text-v1-5:1.5

Enabled

v0.11.2

3.2.5

3.2

1 GB

1XL4

n/a

Red Hat logoGithubredditYoutubeTwitter

Apprendre

Essayez, achetez et vendez

Communautés

À propos de Red Hat

Nous proposons des solutions renforcées qui facilitent le travail des entreprises sur plusieurs plates-formes et environnements, du centre de données central à la périphérie du réseau.

Rendre l’open source plus inclusif

Red Hat s'engage à remplacer le langage problématique dans notre code, notre documentation et nos propriétés Web. Pour plus de détails, consultez le Blog Red Hat.

À propos de la documentation Red Hat

Legal Notice

Theme

© 2026 Red Hat
Retour au début