11st of 6 in AI API backends
agent-service-toolkit
LangGraph agents served by FastAPI with a Streamlit chat client
- Stars
- 4.5k
- License
- MIT
- Last commit
- Oct 2026
- Language
- Python
Overview
Python service where LangGraph v1 agents (interrupt, Command, Store) are served by FastAPI with streaming and non-streaming endpoints, AG-UI support, per-agent URL paths, /threads history and a Postgres checkpointer via docker compose. Includes an AgentClient, a Streamlit chat UI with voice, LangSmith feedback, Groq moderation, a ChromaDB RAG agent, unit, integration and smoke tests. Needs at least one LLM API key.
Who it is for: Python teams serving LangGraph agents over an API
Strengths
- AG-UI endpoint for CopilotKit-style frontends alongside the REST API
- docker compose watch runs Postgres, API and Streamlit with live reload
- Unit and integration tests plus smoke tests for Postgres, Mongo, AG-UI and Langfuse
- Hosted demo on Streamlit Cloud
Weaknesses
- Solo maintainer; issues triaged roughly biweekly
- Streamlit client is a demo UI, not a product frontend
- Content moderation needs a Groq API key
- Tests only run outside Docker
What it needs
- Python, LangChain providers: OpenAI, Anthropic, Google, Ollama, VertexAI, vLLM/SGLang, AG-UI protocol
- Needs LLM API key (OpenAI, Anthropic, Google, Groq, Ollama or others), PostgreSQL (compose), LangSmith (optional), ChromaDB (RAG agent)
- GitHub template
- Docker
- env example file
Also in AI API backends
See all 6| Rank | Project | Score |
|---|---|---|
| 2 | fastapi-langgraph-agent-production-ready-templateFastAPI service for a LangGraph agent with auth, memory and tracing | 55 out of 100 |
| 3 | full-stack-ai-agent-templateProject generator for FastAPI and Next.js apps with agents and RAG | 55 out of 100 |
| #4 | generative-ai-project-templateuv workspace with FastAPI, NiceGUI, LiteLLM and Promptfoo evals | 51 out of 100 |
| #5 | nodejs-api-boilerplateExpress TypeScript CRUD API template with an LLM module generator | 31 out of 100 |
| #6 | genai-apiHono API on Cloudflare Workers proxying Gemini with bearer auth | 28 out of 100 |