Chapter 6. How model experimentation accelerates model selection
The playground provides an interactive environment for evaluating how models respond to your prompts. You can test a single model’s baseline behavior or compare two models side-by-side to find the best fit for your use case.
Multi-model comparison is a Technology Preview feature only. Technology Preview features are not supported with Red Hat production service level agreements (SLAs) and might not be functionally complete. Red Hat does not recommend using them in production. These features provide early access to upcoming product features, enabling customers to test functionality and provide feedback during the development process.
For more information about the support scope of Red Hat Technology Preview features, see Technology Preview Features Support Scope.
You can adjust the following parameters to see how they affect response quality, tone, and latency:
- Temperature
Controls the randomness of the model’s output. Use values between 0 and 2. The temperature value directly influences creativity:
- Values near 0: Produce deterministic and factual responses, for objective or factual tasks.
- Values around 0.7: A common default for balanced output.
- Values near 1: Increase creativity and randomness, for generative or creative tasks.
- Values over 1: Typically produce incoherent output.
- Streaming
- Shows the model’s response as it is generated. This is helpful for testing model latency and seeing the model’s progress in real time. When streaming is off, the full response does not render until it is complete.
- System instructions
- Defines the context, persona, or instructions for the model. The playground provides a default prompt that you can review or edit.
When comparing models, multi-model comparison helps you:
- Evaluate multiple models in a single session instead of configuring separate playground instances.
- Compare response quality, tone, accuracy, and latency across models with the same prompt.
- Assess tradeoffs between open source and commercial models, or between different versions of the same model.
- Select the best model for a specific domain or use case.
Additional resources
6.1. Test model responses Copy linkLink copied to clipboard!
Use the playground to test and evaluate your model responses. You can test a single model or compare two models side-by-side.
Prerequisites
- You have configured a playground for your project.
- At least two models are deployed and available as AI asset endpoints in your project if you want to compare models.
Procedure
-
From the OpenShift AI dashboard, click Gen AI studio
Playground. - From the Model list in the chatbot header bar, select the model that you want to test.
- Adjust model parameters such as temperature, streaming, and system instructions as needed. For more information about these parameters, see How model experimentation accelerates model selection.
- In the chat input field, type a query.
Click Send.
The model response appears in the chat area. The response header shows the name of the model that generated the response.
NoteAfter you send a prompt, the Send button changes to a Stop button. Click it to interrupt the model response.
- Optional: To clear the chat history and start a new conversation, click New Chat. Your playground configuration settings are preserved.
Optional: To compare two models side-by-side, click Compare in the playground configuration panel.
The playground clears your current chat history and copies your configuration to both chat panels. This action cannot be undone.
The interface expands to display two model response panels.
ImportantMulti-model comparison is a Technology Preview feature only. Technology Preview features are not supported with Red Hat production service level agreements (SLAs) and might not be functionally complete. Red Hat does not recommend using them in production. These features provide early access to upcoming product features, enabling customers to test functionality and provide feedback during the development process.
For more information about the support scope of Red Hat Technology Preview features, see Technology Preview Features Support Scope.
- In the Model dropdown for each comparison panel, select a model.
- In the chat input field, enter a prompt to test across both models.
Click Send.
The playground displays responses from both models simultaneously in separate panels.
- Optional: To remove a model from the comparison, click the X in the top-right corner of that model’s chat panel.