The Local LLM Index / Quantization & Formats / #224
bytedance/ABQ-LLM
by bytedance · Quantization & Formats · updated 1y ago
An acceleration library that supports arbitrary bit-width combinatorial quantization operations
27
momentum
248
stars
22
forks
#224
rank
cudallm-inferencemlsysquantized-networksresearch
View on GitHub →