Questo contenuto non è disponibile nella lingua selezionata.
Chapter 2. New features and enhancements
This section describes new features and enhancements in Red Hat OpenShift AI.
2.1. New features
- Support for NVIDIA NIM metrics
You can now view metrics for a NIM model deployed on the NVIDIA NIM model serving platform. The following metrics are available:
- GPU cache usage over time
- Current running, waiting, and max requests count
- Token count
- Time to first token
- Time per output token
- Requests outcomes
For more information, see About the NVIDIA NIM model serving platform.
Note
NIM metrics are automatically enabled for new deployments in 2.17. If you are upgrading to 2.17 from a previous version of Red Hat OpenShift AI and have an existing NIM deployment, you must manually enable NIM metrics for the deployment. For more information, see the NVIDIA NIM model serving platform documentation.
2.2. Enhancements
- Custom images no longer have custom- prefix in image name
-
You can now import a custom workbench image in the OpenShift AI dashboard, the
custom-prefix is no longer applied to the image name.
- Updated OpenShift AI user interface
- The user interface for OpenShift AI has been updated to PatternFly 6. The update includes enhanced theming capabilities and support for an optional dark mode.
