Changelog | AI Gateway

AI Gateway - 2025-11-21

Fri, 21 Nov 2025 00:00:00 GMT

Unified Billing now supports opt-in Zero Data Retention. This ensures supported upstream AI providers (eg OpenAI ZDR) do not retain request and response data.

AI Gateway - 2025-11-14

Fri, 14 Nov 2025 00:00:00 GMT

Supports adding OpenAI compatible Custom Providers for inferencing with AI providers that are not natively supported by AI Gateway
Cost and usage tracking for voice models
You can now use Workers AI via AI Gateway with no additional configuration. Previously, this required generating / passing additional Workers AI tokens.

AI Gateway - Unified Billing

Thu, 06 Nov 2025 00:00:00 GMT

Unified Billing is now in open beta. Connect multiple AI providers (e.g. OpenAI, Anthropic) without any additional setup and pay through a single Cloudflare invoice. To use it, purchase credits in the Cloudflare Dashboard and spend them across providers via AI Gateway.

AI Gateway - 2025-11-03

Mon, 03 Nov 2025 00:00:00 GMT

New supported providers

AI Gateway - 2025-10-29

Wed, 29 Oct 2025 00:00:00 GMT

Add support for pipecat model on Workers AI
Fix OpenAI realtime websocket authentication.

AI Gateway - 2025-10-24

Fri, 24 Oct 2025 00:00:00 GMT

Added cost tracking and observability support for async video generation requests for OpenAI Sora 2 and Google AI Studio Veo 3.
cf-aig-eventId and cf-aig-log-id headers are now returned on all requests including failed requests

AI Gateway - 2025-10-14

Tue, 14 Oct 2025 00:00:00 GMT

The Model playground is now available in the AI Gateway Cloudflare Dashboard, allowing you to request and compare model behaviour across all models supported by AI Gateway.

AI Gateway - 2025-10-07

Tue, 07 Oct 2025 00:00:00 GMT

Add support for Deepgram on Workers AI using Websocket transport.
Added Parallel as a provider.

AI Gateway - OTEL Tracing

Wed, 24 Sep 2025 00:00:00 GMT

Added OpenTelemetry (OTEL) tracing export for better observability and debugging of AI Gateway requests.

AI Gateway - 2025-09-21

Sun, 21 Sep 2025 00:00:00 GMT

Added support for Fal AI provider.
You can now set up custom Stripe usage reporting, and report usage and costs for your users directly to Stripe from AI Gateway.
Fixed incorrectly geoblocked requests for certain regions.

AI Gateway - 2025-09-19

Fri, 19 Sep 2025 00:00:00 GMT

New API endpoint (/compat/v1/models) for listing available models along with their costs.
Unified API now supports Google Vertex AI providers and all their models.
BYOK support for requests using WebSocket transport.

AI Gateway - Data Loss Prevention

Thu, 28 Aug 2025 00:00:00 GMT

Data loss prevention capabilities are now available to scan both incoming prompts and outgoing AI responses for sensitive information, ensuring your AI applications maintain security and compliance standards.

AI Gateway - Dynamic routing

Mon, 25 Aug 2025 00:00:00 GMT

Introduced Dynamic routing that lets you visually or via JSON define flexible request flows that segment users, enforce quotas, and choose models with fallbacks—without changing application code.

AI Gateway - Bring your own keys (BYOK)

Thu, 21 Aug 2025 00:00:00 GMT

Introduced Bring your own keys (BYOK) allowing you to save your AI provider keys securely with Cloudflare Secret Store and manage them through the Cloudflare dashboard.

AI Gateway - New GA providers

Wed, 18 Jun 2025 00:00:00 GMT

We have moved the following providers out of beta and into GA:

AI Gateway - OpenAI Compatibility

Wed, 28 May 2025 00:00:00 GMT

Introduced a new OpenAI-compatible chat completions endpoint to simplify switching between different AI providers without major code modifications.

AI Gateway - 2025-04-22

Tue, 22 Apr 2025 00:00:00 GMT

Increased Max Number of Gateways per account: Raised the maximum number of gateways per account from 10 to 20 for paid users. This gives you greater flexibility in managing your applications as you build and scale.
Streaming WebSocket Bug Fix: Resolved an issue affecting streaming responses over WebSockets. This fix ensures more reliable and consistent streaming behavior across all supported AI providers.
Increased Timeout Limits: Extended the default timeout for AI Gateway requests beyond the previous 100-second limit. This enhancement improves support for long-running requests.

AI Gateway - Cache Key Calculation Changes

Wed, 02 Apr 2025 00:00:00 GMT

We have updated how cache keys are calculated. As a result, new cache entries will be created, and you may experience more cache misses than usual during this transition. Please monitor your traffic and performance, and let us know if you encounter any issues.

AI Gateway - WebSockets

Tue, 18 Mar 2025 00:00:00 GMT

Added WebSockets API to provide a persistent connection for AI interactions, eliminating repeated handshakes and reducing latency.

AI Gateway - Guardrails

Wed, 26 Feb 2025 00:00:00 GMT

Added Guardrails help deploy AI applications safely by intercepting and evaluating both user prompts and model responses for harmful content.

AI Gateway - Updated Log Storage Settings

Wed, 19 Feb 2025 00:00:00 GMT

Introduced customizable log storage settings, enabling users to:
- Define the maximum number of logs stored per gateway.
- Choose how logs are handled when the storage limit is reached:
  - On - Automatically delete the oldest logs to ensure new logs are always saved.
  - Off - Stop saving new logs when the storage limit is reached.

AI Gateway - Added request handling

Thu, 06 Feb 2025 00:00:00 GMT

Added request handling options to help manage AI provider interactions effectively, ensuring your applications remain responsive and reliable.

AI Gateway - New AI Gateway providers

Wed, 05 Feb 2025 00:00:00 GMT

Configuration: Added ElevenLabs, Cartesia, and Cerebras as new providers.

AI Gateway - DeepSeek

Thu, 02 Jan 2025 00:00:00 GMT

Configuration: Added DeepSeek as a new provider.

AI Gateway - AI Gateway Dashboard

Tue, 17 Dec 2024 00:00:00 GMT

Updated dashboard to view performance, costs, and stats across all gateways.

AI Gateway - Bug Fixes

Fri, 13 Dec 2024 00:00:00 GMT

Bug Fixes: Fixed Anthropic errors being cached.
Bug Fixes: Fixed env.AI.run() requests using authenticated gateways returning authentication error.

AI Gateway - OpenRouter

Thu, 28 Nov 2024 00:00:00 GMT

Configuration: Added OpenRouter as a new provider.

AI Gateway - WebSockets API

Tue, 19 Nov 2024 00:00:00 GMT

Configuration: Added WebSockets API which provides a single persistent connection, enabling continuous communication.

AI Gateway - Authentication

Tue, 19 Nov 2024 00:00:00 GMT

Configuration: Added Authentication which adds security by requiring a valid authorization token for each request.

AI Gateway - Grok

Mon, 28 Oct 2024 00:00:00 GMT

Providers: Added Grok as a new provider.

AI Gateway - Vercel SDK

Thu, 17 Oct 2024 00:00:00 GMT

Added Vercel AI SDK. The SDK supports many different AI providers, tools for streaming completions, and more.

AI Gateway - Persistent logs

Thu, 26 Sep 2024 00:00:00 GMT

Logs: AI Gateway now has logs that persist, giving you the flexibility to store them for your preferred duration.

AI Gateway - Logpush

Thu, 26 Sep 2024 00:00:00 GMT

Logs: Securely export logs to an external storage location using Logpush.

AI Gateway - Pricing

Thu, 26 Sep 2024 00:00:00 GMT

Pricing: Added pricing for storing logs persistently.

AI Gateway - Evaluations

Thu, 26 Sep 2024 00:00:00 GMT

Configurations: Use AI Gateway’s Evaluations to make informed decisions on how to optimize your AI application.

AI Gateway - Custom costs

Tue, 10 Sep 2024 00:00:00 GMT

Configuration: AI Gateway now allows you to set custom costs at the request level custom costs to requests, accurately reflect your unique pricing, overriding the default or public model costs.

AI Gateway - Mistral AI

Fri, 02 Aug 2024 00:00:00 GMT

Providers: Added Mistral AI as a new provider.

AI Gateway - Google AI Studio

Tue, 23 Jul 2024 00:00:00 GMT

Providers: Added Google AI Studio as a new provider.

AI Gateway - Custom metadata

Wed, 10 Jul 2024 00:00:00 GMT

AI Gateway now supports adding custom metadata to requests, improving tracking and analysis of incoming requests.

AI Gateway - Logs

Tue, 09 Jul 2024 00:00:00 GMT

Logs are now available for the last 24 hours.

AI Gateway - Custom cache key headers

Mon, 24 Jun 2024 00:00:00 GMT

AI Gateway now supports custom cache key headers.

AI Gateway - Access an AI Gateway through a Worker

Tue, 18 Jun 2024 00:00:00 GMT

Workers AI now natively supports AI Gateway.

AI Gateway - AI Gateway is now GA

Wed, 22 May 2024 00:00:00 GMT

AI Gateway is moving from beta to GA.

AI Gateway - 2024-05-16

Thu, 16 May 2024 00:00:00 GMT

Providers: Added Cohere and Groq as new providers.

AI Gateway - 2024-05-09

Thu, 09 May 2024 00:00:00 GMT

Added new endpoints to the REST API.

AI Gateway - 2024-03-26

Tue, 26 Mar 2024 00:00:00 GMT

LLM Side Channel vulnerability fixed
Providers: Added Anthropic, Google Vertex, Perplexity as providers.

AI Gateway - 2023-10-26

Thu, 26 Oct 2023 00:00:00 GMT

Real-time Logs: Logs are now real-time, showing logs for the last hour. If you have a need for persistent logs, please let the team know on Discord. We are building out a persistent logs feature for those who want to store their logs for longer.
Providers: Azure OpenAI is now supported as a provider!
Docs: Added Azure OpenAI example.
Bug Fixes: Errors with costs and tokens should be fixed.

AI Gateway - 2023-10-09

Mon, 09 Oct 2023 00:00:00 GMT

Logs: Logs will now be limited to the last 24h. If you have a use case that requires more logging, please reach out to the team on Discord.
Dashboard: Logs now refresh automatically.
Docs: Fixed Workers AI example in docs and dash.
Caching: Embedding requests are now cacheable. Rate limit will not apply for cached requests.
Bug Fixes: Identical requests to different providers are not wrongly served from cache anymore. Streaming now works as expected, including for the Universal endpoint.
Known Issues: There's currently a bug with costs that we are investigating.