Local LLM Index / local
← All tools
The Local LLM Index / Quantization & Formats / #26

Andyyyy64/whichllm

by Andyyyy64 · Quantization & Formats · updated 19d ago

Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.

71
momentum
6,028
stars
320
forks
#26
rank
aiapple-siliconbenchmarksclicommand-line-toolggufgpuhuggingfaceinferencellmlocal-llmollama
View on GitHub →

More in Quantization & Formats

Quantization & Formats#3
llamafile
Distribute and run LLMs with a single file.
Quantization & Formats#13
shimmy
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU.
Quantization & Formats#14
cactus
Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and
Quantization & Formats#30
OGAM
The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or