The Local LLM Index / Quantization & Formats / #192

OpenGVLab/OmniQuant

by OpenGVLab · Quantization & Formats · updated 11mo ago

[ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.

34
momentum
967
stars
93
forks
#192
rank
large-language-modelsllmquantization
View on GitHub →