The Local LLM Index / Quantization & Formats / #141
leehack/llamadart
by leehack · Quantization & Formats · updated today
Cross-platform on-device LLM inference for Dart & Flutter: GGUF via llama.cpp and LiteRT-LM on Android, iOS, macOS, Windows, Linux and web.
53
momentum
75
stars
29
forks
#141
rank
dartfluttergguflitert-lmllama-cppllmlocal-llmofflineon-device-aiwebgpu
View on GitHub →