Manage gateways

You have several different options for managing an AI Gateway.

Create gateway

Default gateway

AI Gateway can automatically create a gateway for you. When you use default as a gateway ID and no gateway with that ID exists in your account, AI Gateway creates it on the first authenticated request.

The request that triggers auto-creation must include a valid cf-aig-authorization header. An unauthenticated request to a default gateway that does not yet exist does not create the gateway.

The auto-created default gateway uses the following settings:

Setting	Default value
Authentication	On
Log collection	On
Caching	Off (TTL of 0)
Rate limiting	Off

After creation, you can edit the default gateway settings like any other gateway. If you delete the default gateway, sending a new authenticated request to the default gateway ID auto-creates it again.

Note

Auto-creation only applies to the gateway ID default. Using any other gateway ID requires creating the gateway first.

Create a gateway manually

Dashboard

Go to AI Gateway

1. Log into the Cloudflare dashboard ↗ and select your account.
2. Go to AI > AI Gateway.
3. Select Create Gateway.
4. Enter your Gateway name. Note: Gateway name has a 64 character limit.
5. Select Create.

API

To set up an AI Gateway using the API:

1. Create an API token with the following permissions:

   • AI Gateway - Read
   • AI Gateway - Edit

2. Get your Account ID.

3. Using that API token and Account ID, send a POST request to the Cloudflare API.

Edit gateway

Dashboard

To edit an AI Gateway in the dashboard:

1. Log into the Cloudflare dashboard ↗ and select your account.
2. Go to AI > AI Gateway.
3. Select your gateway.
4. Go to Settings and update as needed.

API

To edit an AI Gateway, send a PUT request to the Cloudflare API.

Note

For more details about what settings are available for editing, refer to Configuration.

Retry requests

You can configure your gateway to automatically retry failed requests to upstream providers. This is useful when you do not control the client and cannot implement client-side retries or backoff logic.

To configure retry settings:

1. Log in to the Cloudflare dashboard ↗ and select your account.
2. Go to AI > AI Gateway and select your gateway.
3. Go to Settings and find the Retry Requests section.
4. Turn on the toggle to turn on automatic retries.
5. Configure the following settings:
   • Retry count — the maximum number of retry attempts (up to 5).
   • Delay — the base delay between retries. Available values: 100ms, 500ms, 1 second, 2 seconds, 3 seconds, or 5 seconds.
   • Backoff — the backoff strategy for subsequent retries: Constant, Linear, or Exponential.
6. Select Save.

These gateway-level defaults apply to all requests routed through the gateway. Per-request headers can override these defaults — refer to Request handling for details.

For more complex failover scenarios where you need to fail across different providers, refer to Dynamic Routing.

Delete gateway

Deleting your gateway is permanent and can not be undone.

Dashboard

To delete an AI Gateway in the dashboard:

1. Log into the Cloudflare dashboard ↗ and select your account.
2. Go to AI > AI Gateway.
3. Select your gateway from the list of available options.
4. Go to Settings.
5. For Delete Gateway, select Delete (and confirm your deletion).

API

To delete an AI Gateway, send a DELETE request to the Cloudflare API.