#66th of 14 in Gateways
Bifrost
Go AI gateway with web UI, fallbacks, budgets and semantic caching
- Stars
- 8.7k
- License
- Apache-2.0
- Last commit
- Oct 2026
- Last release
- Oct 2026
Overview
Bifrost is a Go AI gateway that fronts 23+ providers (OpenAI, Anthropic, Bedrock, Vertex and more) with one OpenAI-compatible API and drop-in paths for the OpenAI, Anthropic and GenAI SDKs. It starts with npx or Docker on port 8080 with a web UI, and adds fallbacks, load balancing, semantic caching, MCP tool access, virtual keys, budgets and Prometheus metrics. Clustering, guardrails and the MCP gateway are enterprise features.
Who it is for: teams wanting a fast self-hosted gateway with governance
Strengths
- Single Go binary via npx or Docker with zero-config web UI on 8080
- Drop-in base URLs for OpenAI, Anthropic and Google GenAI SDKs
- Virtual keys, team budgets, OIDC provisioning and Prometheus metrics
- 11 microsecond added latency at 5k RPS in its own benchmark
Weaknesses
- Guardrails, clustering, adaptive load balancing and MCP gateway are enterprise-only
- Benchmarks are self-reported on t3 instances
- 23+ providers, fewer than LiteLLM or Portkey
- Semantic caching needs a vector store backend
What it needs
- no GPU
- Models: OpenAI, Anthropic, AWS Bedrock, Google Vertex, Azure, Cerebras, Cohere, Mistral, Ollama, Groq and more
- port 8080
Also in Gateways
See all 14| Rank | Project | Score |
|---|---|---|
| 1 | OmniRouteOpenAI-compatible gateway that routes requests across hundreds of AI providers | 86 out of 100 |
| 2 | LiteLLMOpenAI-format gateway and Python SDK for calling 100+ LLM providers | 84 out of 100 |
| 3 | freellmapiOpenAI-compatible router that fails over across free LLM provider tiers | 76 out of 100 |
| #4 | ContextForge MCP GatewayRegistry and proxy federating MCP, A2A, REST and gRPC behind one endpoint | 68 out of 100 |
| #5 | HigressEnvoy-based API gateway with LLM proxy plugins and MCP server hosting | 61 out of 100 |