The Local LLM Index / Quantization & Formats / #140
leehack/llamadart
by leehack · Quantization & Formats · updated today
Cross-platform on-device LLM inference for Dart & Flutter: GGUF via llama.cpp and LiteRT-LM on Android, iOS, macOS, Windows, Linux and web.
54
momentum
88
stars
34
forks
#140
rank
dartfluttergguflitert-lmllama-cppllmlocal-llmofflineon-device-aiwebgpu
View on GitHub →