Chapter 3. Evaluate AutoML results
After an AutoML optimization run completes, review the leaderboard and model details to select the best model for your use case. You can register a model to a model registry or save a notebook for evaluation and exploration.
Prerequisites
- You have created an AutoML optimization run and the run status is Completed. For more information, see Create an AutoML optimization run.
Procedure
- In the OpenShift AI dashboard, click Develop and train > AutoML.
- Click the name of your completed run to view the results.
Review the leaderboard, which ranks trained models by the optimized metric for your task type.
The top-ranked model is highlighted. Click a column header to sort by a different metric.
To view detailed information about a model, click View details from the actions menu.
The model details view includes evaluation metrics, feature importance scores, and a confusion matrix. Feature importance is not available for time series forecasting tasks. The confusion matrix is available for binary and multiclass classification tasks only.
- Review the feature importance and the confusion matrix across models to verify that the best-scoring model produces predictions that you can explain and trust.
- To register the selected model to a model registry, select Register model from the actions menu and select a model registry.
- To save a notebook, select Save notebook from the actions menu.
Verification
- If you registered a model, navigate to the model registry and verify that the model is displayed.
- If you saved a notebook, verify that the notebook file downloaded to your local system.