Local LLM Index
/ local
← All tools
◐
The Local LLM Index
/ Quantization & Formats / #229
leafspark/AutoGGUF
by leafspark · Quantization & Formats · updated 10mo ago
automatically quant GGUF models
26
momentum
227
stars
19
forks
#229
rank
View on GitHub →
More in Quantization & Formats
Quantization & Formats
#1
unsloth
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek
Quantization & Formats
#4
project-maya
Project Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniM
Quantization & Formats
#5
llamafile
Distribute and run LLMs with a single file.
Quantization & Formats
#11
Soup
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.