The Local LLM Index / Quantization & Formats / #120

Epistates/pmetal

by Epistates · Quantization & Formats · updated today

PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving, quantization, and MLX/Metal acceleration.

60
momentum
331
stars
26
forks
#120
rank
aianeapple-silicondeep-learningdistillationfine-tuningggufinference-serverllmllm-inferencellm-traininglora
View on GitHub →