WatchingProposedCloudflareLLM traffic control

Cloudflare AI Gateway

Free caching, rate limits, spend caps and model fallback in front of OpenRouter. Works even from Lambda.

Proposed verdict: drawn from research, not yet confirmed by Nic.

A base-URL change in front of OpenRouter buys caching, budgets and fallback. On my shortlist.

Use it when

Per-client spend caps and logs for AI features, and automatic fallback when a provider is down.

Pricing

Core features free. Logs: 20M events a month included on Workers Paid, then $0.60 per million (pricing changes 1 December 2026).

Provisioning

Official Pulumi package · Official Terraform provider

Worked examples

The LLM streaming proxy

Where it fits

An AI chat or LLM feature: Pick 04.
Caching, spend caps and fallback, on my shortlist.

Sources

AI Gateway

Last reviewed 18 October 2026 by Nicolas Dao

Also in AI

Back to the map →

Want this stack in your AWS account?

Cloudless Labs is a Sydney consultancy. We migrate on-premises systems to AWS, build serverless apps on this stack, and coach teams to ship with Claude Code and Codex.