Local LLM Index / local
← All tools
The Local LLM Index / Quantization & Formats / #11

Andyyyy64/whichllm

by Andyyyy64 · Quantization & Formats · updated 2d ago

Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.

75
momentum
4,661
stars
254
forks
#11
rank
aiapple-siliconbenchmarksclicommand-line-toolggufgpuhuggingfaceinferencellmlocal-llmollama
View on GitHub →

More in Quantization & Formats

Quantization & Formats#2
llamafile
Distribute and run LLMs with a single file.
Quantization & Formats#14
shimmy
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU.
Quantization & Formats#15
cactus
Low-latency AI engine for mobile devices & wearables
Quantization & Formats#32
neural-compressor
SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model