The Local LLM Index / Quantization & Formats / #14
cactus-compute/cactus
by cactus-compute · Quantization & Formats · updated today
Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.
74
momentum
5,542
stars
452
forks
#14
rank
aiandroidarmedgeedge-aiframeworkiosllamacppllmllm-inferencellmsmobile
View on GitHub →