The Local LLM Index / Local UIs & Apps / #85
hwdsl2/docker-ai-stack
by hwdsl2 · Local UIs & Apps · updated today
Deploy a complete, self-hosted AI stack on your own server with one command. Includes Ollama (LLM), AnythingLLM (chat UI), LiteLLM (AI gateway), Whisper (STT), Kokoro (TTS), Embeddings (RAG), and MCP Gateway. Most services run locally; LiteLLM optionally routes to external providers. Multi-arch: amd64, arm64. NVIDIA GPU (CUDA) acceleration.
62
momentum
82
stars
15
forks
#85
rank
aiai-stackarm64dockerdocker-composedocker-imageembeddingsinferencelinuxllmlocal-aimcp
View on GitHub →