LiteLLM
thecontinuitylayer.com/tools/routers/litellmDevelopers and teams who want to run their own router with no per-request fee
Gateway · BerriAI
LiteLLM is an open-source Python library and proxy server that puts many LLM providers behind one OpenAI-style API. You run it yourself, add your own provider keys, and point your apps at it. It works with local servers too, so it can sit in front of models you host on your own hardware.
The free version includes virtual keys, budgets, rate limits, cost tracking, load balancing, fallbacks and guardrails. You pay nothing to LiteLLM, but you take on running and updating the proxy. Features such as SSO with SCIM, audit logs and secret-manager key rotation need a paid enterprise license, which is an annual fee based on request capacity and support, never per token. Enterprise prices are not published.
Specs
| Fees | Free and open source (MIT) to self-host; you pay providers directly; enterprise annual license is custom-priced |
|---|---|
| Routes to | 100+ LLM providers through one OpenAI-compatible proxy (pricing page; homepage says 140+) |
| License | MIT (open source) |
| Fee | None for self-hosting |
| Providers | 100+ |
| Included free | Virtual keys, budgets, rate limits, cost tracking, load balancing, fallbacks, guardrails |
| Enterprise | Annual license, price not published (SSO, SCIM, audit logs, SLA) |
| Hosting | Self-hosted |
Good for
- Self-hosting with no markup
- Mixing cloud APIs with local models
- Per-team budgets
Not for
- People who do not want to run a server
- Teams needing a vendor SLA without an enterprise deal
See also
- Portkey · Teams that want a gateway with logging, guardrails and prompt management
- Vercel AI Gateway · Web developers, especially on Vercel, who want provider prices with no markup
- Cloudflare AI Gateway · Developers who already use their own provider keys and want caching, logs and spend limits for free
We last reviewed LiteLLM on 31 October 2026. Prices and specs change; check litellm.ai before you buy or sign up. Figures we could not confirm on the vendor's own page read “not published” or “varies”.
Vendor source: https://www.litellm.ai/pricing