SupportConsoleDevelopersStart a trialContact

Chapter 4. Enable custom endpoints for the playground

Important

Custom endpoints is a Technology Preview feature only. Technology Preview features are not supported with Red Hat production service level agreements (SLAs) and might not be functionally complete. Red Hat does not recommend using them in production. These features provide early access to upcoming product features, enabling customers to test functionality and provide feedback during the development process.

For more information about the support scope of Red Hat Technology Preview features, see Technology Preview Features Support Scope.

As a platform engineer or cluster administrator, you can enable the custom endpoints feature to let users create endpoints from models that are not deployed in their project namespace. The following dashboard configuration options in the OdhDashboardConfig custom resource control this feature:

  • aiAssetCustomEndpoints controls whether users can see and use the custom endpoints feature. When enabled, users can create endpoints from models deployed in another namespace on the same cluster.
  • externalProviders controls whether users can also create endpoints for external third-party providers such as OpenAI, Anthropic, or AWS. When enabled, data from the responses API can be sent outside the cluster.
  • clusterDomains specifies additional domains that are considered internal to the cluster.
Warning

Enabling external providers allows users to send data from the responses API, including RAG context, MCP tool results, and user input, to endpoints outside the cluster. Evaluate your organization’s data security requirements before enabling this flag.

Prerequisites

  • You have cluster administrator privileges in OpenShift.
  • You have access to the OdhDashboardConfig custom resource.

Procedure

  1. Log in to OpenShift as a cluster administrator.

  2. Open the OdhDashboardConfig custom resource for editing.

    For more information, see Editing the dashboard configuration.

  3. In the spec section, set the following configuration options: 

    spec:
  dashboardConfig:
    aiAssetCustomEndpoints: true
  genAiStudioConfig:
    aiAssetCustomEndpoints:
      externalProviders: true
      clusterDomains: []

where:

aiAssetCustomEndpoints
Specifies whether to show the custom endpoints feature. Set to true to allow users to create custom model endpoints. The default value is false.
externalProviders
Specifies whether users can create external third-party provider endpoints. Set to true to enable external providers. The default value is false. Requires aiAssetCustomEndpoints to also be set to true.
clusterDomains

Specifies an array of domains that are considered internal to the cluster, in addition to .svc.cluster.local, which is always treated as internal.

  1. Save the custom resource.

Verification

  • Users can see the Create endpoint option on the AI asset endpoints page.
  • If you enabled external providers, users can create endpoints for external third-party providers.
Red Hat logoGithubredditYoutubeTwitter

Learn

Try, buy, & sell

Communities

About Red Hat

We deliver hardened solutions that make it easier for enterprises to work across platforms and environments, from the core datacenter to the network edge.

Making open source more inclusive

Red Hat is committed to replacing problematic language in our code, documentation, and web properties. For more details, see the Red Hat Blog.

About Red Hat Documentation

We help Red Hat users innovate and achieve their goals with our products and services with content they can trust. Explore our recent updates.

Legal Notice

Theme

© 2026 Red HatBack to top