11st of 14 in Gateways

OmniRoute

OpenAI-compatible gateway that routes requests across hundreds of AI providers

Stars
75.1k
License
MIT
Last commit
Oct 2026
Last release
Sep 2026
Language
TypeScript

Overview

OmniRoute exposes one OpenAI-compatible endpoint at localhost:20128/v1 and routes requests to a catalog of 357+ providers, including many free tiers, with automatic fallback between them. It also accepts Claude, Gemini and Responses API formats, supports MCP and A2A, and has a dashboard for keys, quotas and free-tier usage. Providers are connected with your own accounts or API keys.

Who it is for: Developers pooling free and paid LLM providers behind one API endpoint

Strengths

  • Single endpoint with automatic fallback across many providers and model IDs
  • Dashboard page tracks free-tier pools and remaining quota
  • Install via npm, Docker or Electron; MIT license
  • Documents the free-tier token math and flags providers with risky terms

Weaknesses

  • Provider count in the README varies (290, 357, 370) across sections
  • The 'auto' model needs at least one eligible connected provider to route
  • Providers marked tos:avoid, such as Kiro, are excluded from auto routing by default
  • Free-tier token estimate depends on third-party limits that change

What it needs

  • no GPU
  • Docker + Compose
  • Compose runs Redis, Qdrant
  • Models: OpenAI API, Claude API, Gemini API, Responses API
  • port 20128

Head to head

Also in Gateways

See all 14
Also in Gateways
RankProjectScore
2LiteLLMOpenAI-format gateway and Python SDK for calling 100+ LLM providers61k stars, custom license84 out of 100
3freellmapiOpenAI-compatible router that fails over across free LLM provider tiers33.1k stars, MIT76 out of 100
#4ContextForge MCP GatewayRegistry and proxy federating MCP, A2A, REST and gRPC behind one endpoint4.6k stars, Apache-2.068 out of 100
#5HigressEnvoy-based API gateway with LLM proxy plugins and MCP server hosting Live demo ↗ (opens in a new tab)9.5k stars, Apache-2.061 out of 100
#6BifrostGo AI gateway with web UI, fallbacks, budgets and semantic caching8.7k stars, Apache-2.059 out of 100