ArchestackGitHub ↗ (opens in a new tab)

#88th of 14 in Gateways

GoModel

Go AI gateway with OpenAI and Anthropic APIs, caching and budgets

Live demo ↗ (opens in a new tab)Documentation ↗ (opens in a new tab)Repository on GitHub ↗ (opens in a new tab)
Stars
1.2k
License
MIT
Last commit
Oct 2026
Last release
Oct 2026

Overview

GoModel is a Go AI gateway (install script or container on port 8080) exposing OpenAI-compatible /v1 and Anthropic /v1/messages endpoints in front of OpenAI, Anthropic, Gemini, Bedrock, Azure, Ollama, vLLM, SGLang and more. It adds exact and semantic caching, cost tracking, budgets, rate limits, failover, an MCP gateway, guardrails and a dashboard with playground. Compose adds Redis, PostgreSQL, MongoDB and Prometheus.

Who it is for: teams wanting a lightweight gateway with cost controls

Strengths

  • Single Go binary or container; official OpenAI and Anthropic SDKs work unchanged
  • Budgets, rate limits, cost tracking and a usage API per user, team or key
  • Exact and semantic caching, failover with circuit breakers, provider key rotation
  • Dashboard with playground, live request stream, Prometheus and OpenTelemetry

Weaknesses

  • Prompt compression, intelligent routing and OIDC SSO are in the paid Pro build
  • Pre-1.0; roadmap points to an upcoming 0.2.0 release
  • Full Compose stack pulls in Redis, PostgreSQL, MongoDB and Prometheus
  • Benchmarks against LiteLLM and Portkey are self-run

What it needs

  • no GPU
  • Docker + Compose
  • Needs Redis, PostgreSQL, MongoDB (Compose infrastructure)
  • Models: OpenAI, Anthropic, xAI, Gemini, Vertex AI, Cohere, DeepSeek, Groq, Fireworks, OpenRouter, Azure OpenAI, Bedrock, Ollama, SGLang, vLLM, llm-d, ElevenLabs and any OpenAI-compatible provider
  • port 8080

Also in Gateways

See all 14
Also in Gateways
RankProjectScore
1OmniRouteOpenAI-compatible gateway that routes requests across hundreds of AI providers74.9k stars, MIT86 out of 100
2LiteLLMOpenAI-format gateway and Python SDK for calling 100+ LLM providers60.9k stars, custom license84 out of 100
3freellmapiOpenAI-compatible router that fails over across free LLM provider tiers32.9k stars, MIT76 out of 100
#4ContextForge MCP GatewayRegistry and proxy federating MCP, A2A, REST and gRPC behind one endpoint4.6k stars, Apache-2.068 out of 100
#5HigressEnvoy-based API gateway with LLM proxy plugins and MCP server hosting Live demo ↗ (opens in a new tab)9.5k stars, Apache-2.061 out of 100