Local LLM Index / local
← All tools
The Local LLM Index / Quantization & Formats / #5

mozilla-ai/llamafile

by mozilla-ai · Quantization & Formats · updated 15d ago

Distribute and run LLMs with a single file.

79
momentum
26,496
stars
1,666
forks
#5
rank
cross-platformggufllama-cpplocal-ailocal-inferencelocal-llmopen-source-aisingle-file-executablespeech-to-text
View on GitHub →

More in Quantization & Formats

Quantization & Formats#1
unsloth
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek
Quantization & Formats#4
project-maya
Project Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniM
Quantization & Formats#11
Soup
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
Quantization & Formats#21
HyperQwen
Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB c