The Local LLM Index / Quantization & Formats / #107
gpustack/gguf-parser-go
by gpustack · Quantization & Formats · updated 15d ago
Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
57
momentum
280
stars
27
forks
#107
rank
ggufgollama-boxllama-cppstable-diffusion-cpp
View on GitHub →