The Local LLM Index / Quantization & Formats / #113
gpustack/gguf-parser-go
by gpustack · Quantization & Formats · updated 3d ago
Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
59
momentum
301
stars
29
forks
#113
rank
ggufgollama-boxllama-cppstable-diffusion-cpp
View on GitHub →