Chapter 2. New features and enhancements
This section describes new features and enhancements in Red Hat OpenShift AI 2-latest.
2.1. New features
- Support for NVIDIA NIM metrics
You can now view metrics for a NIM model deployed on the NVIDIA NIM model serving platform. The following metrics are available:
- GPU cache usage over time
- Current running, waiting, and max requests count
- Token count
- Time to first token
- Time per output token
- Requests outcomes
For more information, see About the NVIDIA NIM model serving platform.
Note
NIM metrics are automatically enabled for new deployments in 2.17. If you are upgrading to 2.17 from a previous version of Red Hat OpenShift AI and have an existing NIM deployment, you must manually enable NIM metrics for the deployment. For more information, see the NVIDIA NIM model serving platform documentation.
2.2. Enhancements
- Custom images no longer have custom- prefix in image name
-
You can now import a custom workbench image in the OpenShift AI dashboard, the
custom-prefix is no longer applied to the image name.
- Updated OpenShift AI user interface
- The user interface for OpenShift AI has been updated to PatternFly 6. The update includes enhanced theming capabilities and support for an optional dark mode.
- Customizable namespaces
-
You can now define a custom namespace for the operator and
DSCI.applicationNamespaceinstead of the default predefined namespaces used by OpenShift AI. To use a custom namespace, label the namespace withopendatahub.io/application-namespace: true.
