Local LLM Index
/ local
← All tools
◐
The Local LLM Index
/ Quantization & Formats / #210
leafspark/AutoGGUF
by leafspark · Quantization & Formats · updated 5mo ago
automatically quant GGUF models
28
momentum
227
stars
19
forks
#210
rank
View on GitHub →
More in Quantization & Formats
Quantization & Formats
#2
llamafile
Distribute and run LLMs with a single file.
Quantization & Formats
#11
whichllm
Find the local LLM that actually runs and performs best on your hardware. Ranked by real,
Quantization & Formats
#14
shimmy
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU.
Quantization & Formats
#15
cactus
Low-latency AI engine for mobile devices & wearables