Skip to content

Model gateway

One endpoint for model providers, reached from any sandbox with no key.

The model gateway is one endpoint for the model providers your organization uses. Code in any sandbox calls it with its workload identity, so you do not put a model provider’s API key in the sandbox.

The gateway:

  • Routes each request to the provider and model you name.
  • Falls back to another provider or model when one fails or is overloaded.
  • Limits use, and reports it with the rest of your usage.

Type to search…

↑↓ navigate↵ selectEsc close