#44th of 6 in AI API backends
generative-ai-project-template
uv workspace with FastAPI, NiceGUI, LiteLLM and Promptfoo evals
- Stars
- 118
- License
- MIT
- Last commit
- Sep 2026
- Last release
- Sep 2026
- Language
- Python
Overview
Python 3.12 uv workspace with a FastAPI backend (port 8000) and NiceGUI frontend (port 8080) for chat, information extraction and RAG over documents, with models served locally by Ollama or through any LiteLLM provider. Ships Makefiles for install, run, test, Docker (CPU and CUDA compose), pre-commit with ruff and detect-secrets, pytest, Promptfoo and Ragas evals, GitHub Actions, Renovate and an mkdocs site.
Who it is for: Python teams starting an LLM app with evals built in
Strengths
- LiteLLM naming lets you switch between Ollama and cloud models by env
- Promptfoo and Ragas evaluation wired into the template
- CPU and CUDA docker compose variants
- CI tests the app against local Ollama models
Weaknesses
- NiceGUI frontend is unusual for product UIs
- No auth, database or persistence described
- Ubuntu 22.04 or macOS only per prerequisites
- CUDA path installs PyTorch; heavier install
What it needs
- Python, LiteLLM (any provider), Ollama
- Needs Ollama (local models) or an LLM provider key via LiteLLM
- GitHub template
- Docker
- env example file
Also in AI API backends
See all 6| Rank | Project | Score |
|---|---|---|
| 1 | agent-service-toolkitLangGraph agents served by FastAPI with a Streamlit chat client | 70 out of 100 |
| 2 | fastapi-langgraph-agent-production-ready-templateFastAPI service for a LangGraph agent with auth, memory and tracing | 55 out of 100 |
| 3 | full-stack-ai-agent-templateProject generator for FastAPI and Next.js apps with agents and RAG | 55 out of 100 |
| #5 | nodejs-api-boilerplateExpress TypeScript CRUD API template with an LLM module generator | 31 out of 100 |
| #6 | genai-apiHono API on Cloudflare Workers proxying Gemini with bearer auth | 28 out of 100 |