ArchestackGitHub ↗ (opens in a new tab)

33rd of 14 in Gateways

freellmapi

OpenAI-compatible router that fails over across free LLM provider tiers

Documentation ↗ (opens in a new tab)Website ↗ (opens in a new tab)Repository on GitHub ↗ (opens in a new tab)
Stars
32.9k
License
MIT
Last commit
Oct 2026
Last release
Oct 2026
Language
TypeScript

Overview

FreeLLMAPI exposes one /v1 endpoint (chat, responses, completions, embeddings, images, video, audio) and routes requests across free tiers from 34 providers, plus custom OpenAI-compatible endpoints. Provider keys are AES-256-GCM encrypted in SQLite, per-key RPM/RPD/TPM/TPD counters keep requests under quotas, and a 429 or 5xx triggers fallover to the next model. It also serves Anthropic Messages, Gemini and opt-in Ollama surfaces, and ships a React dashboard and desktop apps.

Who it is for: Developers stacking free LLM tiers behind one endpoint for coding agents or apps

Strengths

  • Also speaks Anthropic, Gemini and Ollama formats, so Claude Code and Codex CLI connect
  • Per-key rate counters and automatic fallover on 429/5xx across providers
  • Keys AES-256-GCM encrypted in SQLite; apps only see one unified token
  • Runs on Node 20+ at about 40 MB idle RSS, or via Docker

Weaknesses

  • Free installs get new models 30 days after premium; same-day catalog costs $19/yr
  • Single-user by design; no multi-user setup described
  • Depends on free tiers that providers can change or retire without notice
  • Catalog sync pulls a signed feed from freellmapi.co

What it needs

  • no GPU
  • Docker + Compose
  • Needs SQLite, Node 20+, provider API keys
  • Models: OpenAI-compatible API, Anthropic Messages API, Gemini API, Ollama API
  • port 3001

Also in Gateways

See all 14
Also in Gateways
RankProjectScore
1OmniRouteOpenAI-compatible gateway that routes requests across hundreds of AI providers74.9k stars, MIT86 out of 100
2LiteLLMOpenAI-format gateway and Python SDK for calling 100+ LLM providers60.9k stars, custom license84 out of 100
#4ContextForge MCP GatewayRegistry and proxy federating MCP, A2A, REST and gRPC behind one endpoint4.6k stars, Apache-2.068 out of 100
#5HigressEnvoy-based API gateway with LLM proxy plugins and MCP server hosting Live demo ↗ (opens in a new tab)9.5k stars, Apache-2.061 out of 100
#6BifrostGo AI gateway with web UI, fallbacks, budgets and semantic caching8.7k stars, Apache-2.059 out of 100