发行注记
Red Hat AI Inference Server 3.0
Red Hat AI Inference Server 发行版的主要新功能及变化信息
摘要
此发行注记介绍了 Red Hat AI Inference Server 的新功能、功能增强、重要的技术变化、以及对以前版本中的错误作出的主要修正。
前言 复制链接链接已复制到粘贴板!
复制链接链接已复制到粘贴板!
Red Hat AI Inference Server 为开发人员和 IT 组织提供一个可扩展的推销平台,用于在具有最少的配置和资源使用量的情况下在安全、可扩展的资源上部署和自定义 AI 模型。
第 1 章 关于此版本 复制链接链接已复制到粘贴板!
复制链接链接已复制到粘贴板!
Red Hat AI Inference Server 现已发布。此 Red Hat AI Inference Server 3.0 发行版本提供了容器镜像,用于优化 NVIDIA 和 ROCm 加速器的大型语言模型(LLM)。容器镜像可从 registry.redhat.io 提供:
-
registry.redhat.io/rhaiis/vllm-cuda-rhel9:3.0.0 -
registry.redhat.io/rhaiis/vllm-rocm-rhel9:3.0.0
利用红帽 AI Inference Server,您可以以更高的性能、更低的成本以及企业级稳定性和安全性提供高性能和推测模型。Red Hat AI Inference Server 基于上游开源 vLLM 软件项目构建。
第 2 章 新功能及功能增强 复制链接链接已复制到粘贴板!
复制链接链接已复制到粘贴板!
如需 vLLM 的新功能和功能增强的完整列表,请查看上游 vLLM v0.8.4 发行注记。
法律通告 复制链接链接已复制到粘贴板!
复制链接链接已复制到粘贴板!
Copyright © 2025 Red Hat, Inc.
The text of and illustrations in this document are licensed by Red Hat under a Creative Commons Attribution–Share Alike 3.0 Unported license ("CC-BY-SA"). An explanation of CC-BY-SA is available at http://creativecommons.org/licenses/by-sa/3.0/. In accordance with CC-BY-SA, if you distribute this document or an adaptation of it, you must provide the URL for the original version.
Red Hat, as the licensor of this document, waives the right to enforce, and agrees not to assert, Section 4d of CC-BY-SA to the fullest extent permitted by applicable law.
Red Hat, Red Hat Enterprise Linux, the Shadowman logo, the Red Hat logo, JBoss, OpenShift, Fedora, the Infinity logo, and RHCE are trademarks of Red Hat, Inc., registered in the United States and other countries.
Linux® is the registered trademark of Linus Torvalds in the United States and other countries.
Java® is a registered trademark of Oracle and/or its affiliates.
XFS® is a trademark of Silicon Graphics International Corp. or its subsidiaries in the United States and/or other countries.
MySQL® is a registered trademark of MySQL AB in the United States, the European Union and other countries.
Node.js® is an official trademark of Joyent. Red Hat is not formally related to or endorsed by the official Joyent Node.js open source or commercial project.
The OpenStack® Word Mark and OpenStack logo are either registered trademarks/service marks or trademarks/service marks of the OpenStack Foundation, in the United States and other countries and are used with the OpenStack Foundation's permission. We are not affiliated with, endorsed or sponsored by the OpenStack Foundation, or the OpenStack community.
All other trademarks are the property of their respective owners.