红帽全球峰会Red Hat AI Inference Server 3.2
Welcome
发行注记
Red Hat AI Inference Server 发行版的主要新功能及变化信息
开始使用
Red Hat AI Inference Server 入门
在断开连接的环境中安装 Red Hat AI Inference Server
使用 OpenShift Container Platform 和断开连接的镜像 registry 在断开连接的环境中安装 Red Hat AI Inference Server。
在断开连接的环境中部署 Red Hat AI Inference Server
使用 OpenShift Container Platform 和断开连接的镜像 registry 在断开连接的环境中部署 Red Hat AI Inference Server
在 OpenShift Container Platform 中部署 Red Hat AI Inference Server
在已安装支持的 AI Accelerator 的 OpenShift Container Platform 集群中部署 Red Hat AI Inference Server
Supported product and hardware configurations
Supported hardware and software configurations for deploying Red Hat AI software
Validated models
Red Hat AI validated models
Inference Operations
OCI 兼容模型容器中的 inference 服务语言模型
在 Red Hat AI Inference Server 中推断 OCI 兼容模型
vLLM 服务器参数
运行 Red Hat AI Inference Server 的服务器参数
Red Hat AI Model Optimization Toolkit
使用 LLM Compressor 库压缩大型语言模型
Extending Red Hat AI Inference Server with tool calling capabilities
Configuring tool calling and chat templates for AI Inference Server
Related Products
Red Hat OpenShift AI
Find release notes and product documentation for using the OpenShift AI platform and its integrated MLOps capabilities to manage predictive and generative AI models at scale
Red Hat Enterprise Linux AI
Switch to the Red Hat Enterprise Linux AI documentation
Additional Resources
Product life cycle
Understand the product life cycle to plan deployments and support applications using the product
Red Hat AI learning hub
Explore a curated collection of learning resources designed to help you accomplish key tasks with Red Hat AI products and services
'%20d='M201.5%20305.5c-13.8%200-24.9-11.1-24.9-24.6%200-13.8%2011.1-24.9%2024.9-24.9%2013.6%200%2024.6%2011.1%2024.6%2024.9%200%2013.6-11.1%2024.6-24.6%2024.6zM504%20256c0%20137-111%20248-248%20248S8%20393%208%20256%20119%208%20256%208s248%20111%20248%20248zm-132.3-41.2c-9.4%200-17.7%203.9-23.8%2010-22.4-15.5-52.6-25.5-86.1-26.6l17.4-78.3%2055.4%2012.5c0%2013.6%2011.1%2024.6%2024.6%2024.6%2013.8%200%2024.9-11.3%2024.9-24.9s-11.1-24.9-24.9-24.9c-9.7%200-18%205.8-22.1%2013.8l-61.2-13.6c-3-.8-6.1%201.4-6.9%204.4l-19.1%2086.4c-33.2%201.4-63.1%2011.3-85.5%2026.8-6.1-6.4-14.7-10.2-24.1-10.2-34.9%200-46.3%2046.9-14.4%2062.8-1.1%205-1.7%2010.2-1.7%2015.5%200%2052.6%2059.2%2095.2%20132%2095.2%2073.1%200%20132.3-42.6%20132.3-95.2%200-5.3-.6-10.8-1.9-15.8%2031.3-16%2019.8-62.5-14.9-62.5zM302.8%20331c-18.2%2018.2-76.1%2017.9-93.6%200-2.2-2.2-6.1-2.2-8.3%200-2.5%202.5-2.5%206.4%200%208.6%2022.8%2022.8%2087.3%2022.8%20110.2%200%202.5-2.2%202.5-6.1%200-8.6-2.2-2.2-6.1-2.2-8.3%200zm7.7-75c-13.6%200-24.6%2011.1-24.6%2024.9%200%2013.6%2011.1%2024.6%2024.6%2024.6%2013.8%200%2024.9-11.1%2024.9-24.6%200-13.8-11-24.9-24.9-24.9z'/%3e%3c/svg%3e){kind=small}