The Local LLM Index / Quantization & Formats / #54
intel/auto-round
by intel · Quantization & Formats · updated today
A SOTA quantization toolkit for high-accuracy low-bit LLM inference|简洁且高效的量化工具包
68
momentum
1,611
stars
174
forks
#54
rank
diffusersggufint4llmsmxfp4nvfp4omniquantizationroundingsglangtransformersvllm
View on GitHub →