The Local LLM Index / Quantization & Formats / #48
cactus-compute/cactus
by cactus-compute · Quantization & Formats · updated 1mo ago
Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.
69
momentum
6,162
stars
516
forks
#48
rank
aiandroidarmedgeedge-aiframeworkiosllamacppllmllm-inferencellmsmobile
View on GitHub →