The Local LLM Index / Quantization & Formats / #169
AutoGPTQ/AutoGPTQ
by AutoGPTQ · Quantization & Formats · updated 1y ago
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
42
momentum
5,070
stars
546
forks
#169
rank
deep-learninginferencelarge-language-modelsllmsnlppytorchquantizationtransformertransformers
View on GitHub →