https://localllm.kymatalabs.com The living index of tools for running LLMs locally and on-device. https://localllm.kymatalabs.com/p/mintplex-labs-anything-llm/Mintplex-Labs/anything-llmStop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience https://localllm.kymatalabs.com/p/mozilla-ai-llamafile/mozilla-ai/llamafileDistribute and run LLMs with a single file. https://localllm.kymatalabs.com/p/mlc-ai-web-llm/mlc-ai/web-llmHigh-performance In-browser LLM Inference Engine https://localllm.kymatalabs.com/p/alibaba-mnn/alibaba/MNNMNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI. https://localllm.kymatalabs.com/p/chenhg5-cc-connect/chenhg5/cc-connectBridge local AI coding agents (Claude Code, Cursor, Gemini CLI, Codex) to messaging platforms (Feishu/Lark, DingTalk, Slack, Telegram, Discord, LINE, WeChat Work). Chat with your AI dev assistant from anywhere — no public IP required for most platforms. https://localllm.kymatalabs.com/p/runanywhereai-runanywhere-sdks/RunanywhereAI/runanywhere-sdksProduction ready toolkit to run AI locally https://localllm.kymatalabs.com/p/openbmb-minicpm/OpenBMB/MiniCPMMiniCPM5-1B: A SOTA 1B on-device LLM, small yet powerful. https://localllm.kymatalabs.com/p/learningcircuit-local-deep-research/LearningCircuit/local-deep-research~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encrypted. https://localllm.kymatalabs.com/p/qualcomm-nexa-sdk/qualcomm/nexa-sdkRun frontier LLMs and VLMs with day-0 model support across GPU, NPU, and CPU, with comprehensive runtime coverage for PC (Python/C++), mobile (Android & iOS), and Linux/IoT (Arm64 & x86 Docker). Supporting OpenAI GPT-OSS, IBM Granite-4, Qwen-3-VL, Gemma-3n, Ministral-3, and more. https://localllm.kymatalabs.com/p/lightseekorg-tokenspeed/lightseekorg/tokenspeedTokenSpeed is a speed-of-light LLM inference engine. https://localllm.kymatalabs.com/p/andyyyy64-whichllm/Andyyyy64/whichllmFind the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly. https://localllm.kymatalabs.com/p/di-sukharev-opencommit/di-sukharev/opencommittop #1 and most feature rich GPT wrapper for git — generate commit messages with an LLM in 1 sec — works with Claude, GPT and every other provider, supports local Ollama models too https://localllm.kymatalabs.com/p/google-ai-edge-litert-lm/google-ai-edge/LiteRT-LMLiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices. https://localllm.kymatalabs.com/p/michael-a-kuykendall-shimmy/Michael-A-Kuykendall/shimmy⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary. https://localllm.kymatalabs.com/p/cactus-compute-cactus/cactus-compute/cactusLow-latency AI engine for mobile devices & wearables https://localllm.kymatalabs.com/p/nicedreamzapp-claude-code-local/nicedreamzapp/claude-code-localRun Claude Code 100% on-device with local AI on Apple Silicon. MLX-native Anthropic-API server, 65 tok/s Qwen 3.5 122B, Llama 3.3 70B, Gemma 4 31B. Private, offline, airgap-ready. Built for NDA / legal / healthcare workflows. https://localllm.kymatalabs.com/p/thunderbird-thunderbolt/thunderbird/thunderboltAI You Control: Choose your models. Own your data. Eliminate vendor lock-in. https://localllm.kymatalabs.com/p/dograh-hq-dograh/dograh-hq/dograhOpen source voice AI platform. Self-hosted alternative to Vapi and Retell. On Prem, BYOK across Speech to Speech or LLM/STT/TTS, with a visual workflow builder, MCP native and telephony support. https://localllm.kymatalabs.com/p/lemonade-sdk-lemonade/lemonade-sdk/lemonadeLemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk https://localllm.kymatalabs.com/p/fikrikarim-parlor/fikrikarim/parlorOn-device, real-time multimodal AI. Have natural voice and vision conversations with an AI that runs entirely on your machine. Powered by Gemma 4 E2B and Kokoro. https://localllm.kymatalabs.com/p/itayinbarr-little-coder/itayinbarr/little-coderA harness optimized to smaller LLMs https://localllm.kymatalabs.com/p/techjarves-usb-uncensored-llm/techjarves/USB-Uncensored-LLMThe ultimate zero-install, portable local AI environment. Run high-quality, uncensored LLMs (Gemma, Qwen, NemoMix) directly from any USB drive or SSD. Fully air-gapped, cross-platform (Win/Mac/Linux), and privacy-first with persistent chat history. https://localllm.kymatalabs.com/p/langroid-langroid/langroid/langroidHarness LLMs with Multi-Agent Programming https://localllm.kymatalabs.com/p/raullenchai-rapid-mlx/raullenchai/Rapid-MLXThe fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Drop-in OpenAI replacement. Works with Claude Code, Cursor, Aider. https://localllm.kymatalabs.com/p/mininglamp-ai-mano-p/Mininglamp-AI/Mano-PMano-P: Open-source GUI-VLA agent for edge devices. #1 on OSWorld (specialized, 58.2%). Runs locally on Apple M4 Mac mini/MacBook — no data leaves your device.Mano-P 是一个开源 GUI-VLA 项目，支持在 Mac mini/MacBook 上或通过算力棒本地运行推理，实现纯视觉驱动的跨平台 GUI 自动化操作。数据完全本地处理，支持复杂多步骤任务规划与执行。 https://localllm.kymatalabs.com/p/deta-surf/deta/surfPersonal AI Notebooks. Organize files & webpages and generate notes from them. Open source, local & open data, open model choice (incl. local). https://localllm.kymatalabs.com/p/xyproto-algernon/xyproto/algernonSmall self-contained pure-Go web server with Lua, Teal, Markdown, Ollama, HTTP/2, QUIC, Redis, TypeScript, SQLite and PostgreSQL support ++ https://localllm.kymatalabs.com/p/spiceai-spiceai/spiceai/spiceaiA portable accelerated SQL query, search, and LLM-inference engine, written in Rust, for data-grounded AI apps and agents. https://localllm.kymatalabs.com/p/kellyvv-phoneclaw/kellyvv/PhoneClawPhoneClaw: On-device AI Agent for Phone powered by Gemma 4 https://localllm.kymatalabs.com/p/caviraoss-openmemory/CaviraOSS/OpenMemoryLocal persistent memory store for LLM applications including claude desktop, github copilot, codex, antigravity, etc.