KYMATATHE LIVING INDEXES
The Living IndexesThe Local LLM Index
The Local LLM Index / Quantization & Formats / #161

Thireus/GGUF-Tool-Suite

by Thireus · Quantization & Formats · updated 1mo ago

Produce your own Dynamic 3.0 Quants and achieve optimum accuracy & SOTA quantization performance! Input a target size and the toolchain will create a GGUF recipe tuned to your hardware within seconds — flexible model sizing and lowest achievable perplexity/kld for GGUF enthusiasts seeking precise and automated dynamic quant production.

47
momentum
171
stars
19
forks
#161
rank
View on GitHub →