The model gateway is one endpoint for the model providers your organization uses. Code in any sandbox calls it with its workload identity, so you do not put a model provider’s API key in the sandbox.
The gateway:
- Routes each request to the provider and model you name.
- Falls back to another provider or model when one fails or is overloaded.
- Limits use, and reports it with the rest of your usage.