The Local LLM Index / Quantization & Formats / #198

OpenGVLab/OmniQuant

by OpenGVLab · Quantization & Formats · updated 9mo ago

[ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.

33
momentum
929
stars
90
forks
#198
rank
large-language-modelsllmquantization
View on GitHub →