#4 in AI Development PlatformsUpdated 2026-08

LLM Gateway

by LLM Gateway · Unified OpenAI-compatible API for 40+ LLM providers

78.1 — BenchRank score out of 100

Homepage
Pricing page

Visit website See full AI Development Platforms ranking

Overview

LLM Gateway routes API requests to 40+ providers and 200+ models through a single OpenAI-compatible endpoint, so existing SDK code only needs a new base URL. It tracks cost, latency, tokens, errors and cache hit rate per request and project, and fails over to another provider when one is unavailable. It can be run hosted or self-hosted under AGPLv3.

Best for: Developers routing requests across many LLM providers through one OpenAI-compatible API.
Pricing: Free with your own provider keys or self-hosted; hosted use is pay-per-token at provider rates plus a flat 5% fee on credit top-ups, with Enterprise priced on request.
Runs on: WebSelf-hosted

Strengths and trade-offs

Strengths

One OpenAI-compatible API for 40+ providers and 200+ models
Free routing when you bring your own provider keys
Self-hostable at no cost under AGPLv3
Tracks cost, latency, errors and cache hits per project

Trade-offs

Credit top-ups carry a flat 5% fee, plus 1.5% on non-US cards
Free plan keeps data 30 days; unlimited retention is Enterprise only
Free-plan support is the Discord community only
Only 3 free models, rate limited to 20 requests per minute

Pricing

Published plans from LLM Gateway’s own pricing page, in USD. Usage charges and add-ons may apply on top.

LLM Gateway pricing tiers, monthly rates in USD
Plan	Monthly	Includes
Credits	—5% fee on credit top-ups	Pay-as-you-go credits at provider token rates Flat 5% platform fee on top-ups, no token markup No subscription, seats or minimums Non-US cards add a 1.5% international fee
Bring your own keys	—	Route through your own provider API keys, no platform fee Pay providers directly Routing, tracking and analytics included Optional full payload retention at $0.01 per 1M tokens
Self-host	—	Free forever, AGPLv3-licensed Full routing layer on your own infrastructure
Enterprise	Contact sales	Volume discounts on credits and custom routing rules Unlimited data retention and 99.9% uptime SLA SAML 2.0/OIDC SSO with SCIM, audit logs, guardrails 30-day trial, 24/7 SLA support and a Slack channel

How this score is made up

Each dimension is scored out of 100 and combined into the headline score using fixed weights.

MCP support: 60 out of 100
API quality: 40 out of 100
Documentation: 90 out of 100
Agent friendliness: 98 out of 100
Pricing transparency: 100 out of 100
Changelog: 100 out of 100
Marketing site structure: 85 out of 100
Operational trust: 90 out of 100

Measured, but not part of the score

Useful to know, but not a mark for or against the product — so these do not affect the ranking.

Openness: 85 out of 100
Maintenance: 90 out of 100

This doesn’t look right — report a problem with LLM Gateway’s score

Alternatives in AI Development Platforms

Ranked 1
84.6 — BenchRank score out of 100
Mem0
Mem0 · Hosted memory layer for AI agents, with Python and Node SDKs
Best for: Developer teams adding persistent memory to AI agents through a hosted API, with a free tier
Ranked 2
84 — BenchRank score out of 100
Nango
Nango · Code-first integration platform covering 900+ APIs
Best for: Product teams building many third-party API integrations into a SaaS product or AI agent
Ranked 3
82.4 — BenchRank score out of 100
Supermemory
Supermemory · Memory and retrieval layer for AI agents
Best for: Developers giving AI agents persistent memory and retrieval through a single hosted API.