The Local LLM Index / Quantization & Formats / #124
gpustack/gguf-parser-go
by gpustack · Quantization & Formats · updated 4d ago
Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
59
momentum
307
stars
31
forks
#124
rank
ggufgollama-boxllama-cppstable-diffusion-cpp
View on GitHub →