#7 in AI Development PlatformsUpdated 2026-08

LiteLLM

by LiteLLM · Open-source AI gateway for routing, spend control and governance

75.4 — BenchRank score out of 100

Homepage
Pricing page

Visit website See full AI Development Platforms ranking

Overview

LiteLLM is an open-source AI gateway that puts LLM providers, agents and MCP servers behind one OpenAI-compatible API and login. It tracks spend per key, user, team and org, applies budgets and rate limits that stop requests at the cap, and routes across providers. You self-host it via Docker, Helm or Terraform on your own Postgres and Redis.

Best for: Platform teams self-hosting one gateway for LLM access, spend caps and routing across providers.
Pricing: The self-hosted open-source gateway is free with no licence fee; Enterprise is an annual contract sized to request capacity, with no figures published.
Runs on: Self-hosted

Strengths and trade-offs

Strengths

One OpenAI-compatible API to 140+ providers and 1,800+ models
Hard budgets per key, team and org; requests stop at the cap
MIT-licensed core, self-hostable including air-gapped
Docker, Helm and Terraform deploys onto your own Postgres and Redis

Trade-offs

You run and maintain it yourself, including Postgres and Redis
SSO, RBAC and audit logs are Enterprise-only, not in the free tier
Enterprise price is not published: annual contract, quoted by sales
Latency benchmarks are LiteLLM's own, run against a mock upstream

Pricing

Published plans from LiteLLM’s own pricing page, in USD. Usage charges and add-ons may apply on top.

LiteLLM pricing tiers, monthly and annual rates in USD
Plan	Monthly	Annual (per month)	Includes
Open Source	Freeself-hosted	Free	100+ providers behind one OpenAI API Virtual keys, users, teams and spend tracking Budgets, rate limits and LLM fallbacks Request/response logging and Prometheus metrics
Enterprise	Contact sales	—	SSO, SCIM, OIDC/JWT auth and RBAC Audit logs, secret managers and key rotation Multi-region control plane, air-gap available 24/7 support, SLAs and volume discounts

How this score is made up

Each dimension is scored out of 100 and combined into the headline score using fixed weights.

MCP support: 60 out of 100
API quality: 70 out of 100
Documentation: 80 out of 100
Agent friendliness: 72 out of 100
Pricing transparency: 100 out of 100
Changelog: 100 out of 100
Marketing site structure: 80 out of 100
Operational trust: 40 out of 100

Measured, but not part of the score

Useful to know, but not a mark for or against the product — so these do not affect the ranking.

Openness: 55 out of 100
Maintenance: 100 out of 100

This doesn’t look right — report a problem with LiteLLM’s score

Alternatives in AI Development Platforms

Ranked 1
84.6 — BenchRank score out of 100
Mem0
Mem0 · Hosted memory layer for AI agents, with Python and Node SDKs
Best for: Developer teams adding persistent memory to AI agents through a hosted API, with a free tier
Ranked 2
84 — BenchRank score out of 100
Nango
Nango · Code-first integration platform covering 900+ APIs
Best for: Product teams building many third-party API integrations into a SaaS product or AI agent
Ranked 3
82.4 — BenchRank score out of 100
Supermemory
Supermemory · Memory and retrieval layer for AI agents
Best for: Developers giving AI agents persistent memory and retrieval through a single hosted API.