The Local LLM Index / Quantization & Formats / #127

jjang-ai/jangq

by jjang-ai · Quantization & Formats · updated today

JANG — GGUF for MLX. YOU MUST USE JANG_Q RUNTIME. Adaptive Mixed-Precision Quantization + Runtime for Apple Silicon

59
momentum
231
stars
28
forks
#127
rank
apple-siliconggufjang-quantizationllamacppllmmlxmlxllmomlxomlx-alternativequantization
View on GitHub →