Ranked open-source alternatives to Vercel AI Gateway
Compare capabilities, licensing, and ownership model. Stars help with discovery; they are not a security or product-fit guarantee.

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, Huggin
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, Vertex
- Best for
- AI product teams
- Deployment
- Inspectable source
- License
- License not declared
- Activity
- Updated 26 hours ago

A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API. Review the official repository, license, release activity,
- Best for
- AI product teams
- Deployment
- Inspectable source
- License
- MIT
- Activity
- Updated 2 months ago

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.
Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS. Review the officia
- Best for
- AI product teams
- Deployment
- Inspectable source
- License
- Apache-2.0
- Activity
- Updated 26 hours ago

Manages Unified Access to Generative AI Services built on Envoy Gateway
Manages Unified Access to Generative AI Services built on Envoy Gateway Review the official repository, license, release activity, and deployment documentation before production ad
- Best for
- AI product teams
- Deployment
- Inspectable source
- License
- Apache-2.0
- Activity
- Updated 29 hours ago

Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface. Review the official repository, license, release activity, and deployment docum
- Best for
- AI product teams
- Deployment
- Inspectable source
- License
- License not declared
- Activity
- Updated 26 hours ago

Drop-in proxy for OpenAI, Anthropic, and other LLM APIs. Logging, PII redaction, prompt versioning, and evals out of the box.
Drop-in proxy for OpenAI, Anthropic, and other LLM APIs. Logging, PII redaction, prompt versioning, and evals out of the box. Review the official repository, license, release activ
- Best for
- AI product teams
- Deployment
- Self-hostable
- License
- AGPL-3.0
- Activity
- Updated Jun 26, 2026