The Local LLM Index / Quantization & Formats / #222

matt-c1/llama-3-quant-comparison

by matt-c1 · Quantization & Formats · updated 2y ago

Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.

25
momentum
169
stars
4
forks
#222
rank
View on GitHub →