Local LLM Index / local
← All tools
The Local LLM Index / Quantization & Formats / #100

Epistates/pmetal

by Epistates · Quantization & Formats · updated 7d ago

PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving, quantization, and MLX/Metal acceleration.

58
momentum
296
stars
20
forks
#100
rank
aianeapple-silicondeep-learningdistillationfine-tuningggufinference-serverllmllm-inferencellm-traininglora
View on GitHub →

More in Quantization & Formats

Quantization & Formats#2
llamafile
Distribute and run LLMs with a single file.
Quantization & Formats#11
whichllm
Find the local LLM that actually runs and performs best on your hardware. Ranked by real,
Quantization & Formats#14
shimmy
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU.
Quantization & Formats#15
cactus
Low-latency AI engine for mobile devices & wearables