calcuis/gguf

Distribute and run LLMs with a single file.

Find the local LLM that actually runs and performs best on your hardware. Ranked by real,

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU.

Low-latency AI engine for mobile devices & wearables