KYMATATHE LIVING INDEXES
The Living IndexesThe Local LLM Index
The Local LLM Index / Quantization & Formats / #18

cactus-compute/engine

by cactus-compute · Quantization & Formats · updated today

2bit quants, kernels and runtime for consumer devices.

75
momentum
6,181
stars
516
forks
#18
rank
aiandroidarmedgeedge-aiframeworkiosllamacppllmllm-inferencellmsmobile
View on GitHub →

More in Quantization & Formats

Quantization & Formats#1
unsloth
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek
Quantization & Formats#4
llamafile
Distribute and run LLMs with a single file.
Quantization & Formats#7
project-maya
Run GLM-5.3-Flash (321B), DeepSeek-V4.1-Flash (748B) and MiniMax-M3.1-Flash (428B) on your
Quantization & Formats#12
Soup
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.