The Local LLM Index / Quantization & Formats / #226

matt-c1/llama-3-quant-comparison

by matt-c1 · Quantization & Formats · updated 2y ago

Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.

25
momentum
170
stars
4
forks
#226
rank
View on GitHub →