The Local LLM Index / Quantization & Formats / #138

Epistates/pmetal

by Epistates · Quantization & Formats · updated 1mo ago

PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving, quantization, and MLX/Metal acceleration.

51
momentum
306
stars
23
forks
#138
rank
aianeapple-silicondeep-learningdistillationfine-tuningggufinference-serverllmllm-inferencellm-traininglora
View on GitHub →