The Local LLM Index / Quantization & Formats / #20
cactus-compute/cactus
by cactus-compute · Quantization & Formats · updated 3d ago
Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.
74
momentum
6,004
stars
502
forks
#20
rank
aiandroidarmedgeedge-aiframeworkiosllamacppllmllm-inferencellmsmobile
View on GitHub →