Chapter 1. Troubleshooting OpenShift Lightspeed
Review solutions and workarounds for common installation, configuration, and operational issues encountered with the OpenShift Lightspeed.
1.1. 502 Bad Gateway Errors in the interface Copy linkLink copied to clipboard!
Avoid 502 Bad Gateway errors by waiting for all internal OpenShift Lightspeed and OpenShift Container Platform system components to stabilize after deployment.
Wait a few minutes and try using OpenShift Lightspeed again.
1.2. Operator Missing from the Operator Hub list Copy linkLink copied to clipboard!
The OpenShift Lightspeed Operator is visible in the Operator Hub only for supported architectures, as filtering prevents it from appearing on non-x86 platforms.
OpenShift Lightspeed is only supported on x86 architecture.
1.3. Thinking model generates delineator prompt Copy linkLink copied to clipboard!
Reasoning models use delineators, such as THOUGHT or reasoning, to distinguish internal thought processes from the final response provided by the OpenShift Lightspeed Service.
The OpenShift Lightspeed Service does not configure the delineator behavior or produce the delineators in the output. The delineator feature is a model configuration setting. Typically, you can disable the feature using one of the following methods:
-
Append your question prompt with the specific keyword that the model requires to disable the delineator feature, for example,
/nothink. For more information, see the documentation for the model you are using. - Modify the inference server configuration settings to disable the delineator feature. For more information, see the documentation for the inference server or for the model you are using.