Local LLM Index / local
← All tools
The Local LLM Index / Quantization & Formats / #3

mozilla-ai/llamafile

by mozilla-ai · Quantization & Formats · updated today

Distribute and run LLMs with a single file.

81
momentum
25,459
stars
1,533
forks
#3
rank
cross-platformggufllama-cpplocal-ailocal-inferencelocal-llmopen-source-aisingle-file-executablespeech-to-text
View on GitHub →

More in Quantization & Formats

Quantization & Formats#13
shimmy
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU.
Quantization & Formats#14
cactus
Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and
Quantization & Formats#26
whichllm
Find the local LLM that actually runs and performs best on your hardware. Ranked by real,
Quantization & Formats#30
OGAM
The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or