Local LLM Index / local
← All tools
The Local LLM Index / Quantization & Formats / #109

Epistates/pmetal

by Epistates · Quantization & Formats · updated 1d ago

PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving, quantization, and MLX/Metal acceleration.

60
momentum
311
stars
26
forks
#109
rank
aianeapple-silicondeep-learningdistillationfine-tuningggufinference-serverllmllm-inferencellm-traininglora
View on GitHub →

More in Quantization & Formats

Quantization & Formats#1
unsloth
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek
Quantization & Formats#4
llamafile
Distribute and run LLMs with a single file.
Quantization & Formats#13
qwen38-27b-rtx3090
Qwen3.8-27B on a single RTX 3090 with vLLM: ~1,000 tok/s at 64 concurrent (int8 tensor-cor
Quantization & Formats#18
Soup
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.