The Local LLM Index / Quantization & Formats / #89
tetherto/qvac
by tetherto · Quantization & Formats · updated today
Open-source local AI SDK - run AI on-device with no cloud, no API keys. Supports GGUF, RAG, image, music, and video generation, speech-to-text, P2P inference, and more. Cross-platform: Linux, macOS, Windows, Android, iOS.
63
momentum
601
stars
111
forks
#89
rank
ai-sdkdecentralized-aillamallm-inferencelocal-ailocal-fine-tuninglocal-llmnodejson-device-aiopen-source-aiopen-source-llmopen-source-rag
View on GitHub →