KYMATATHE LIVING INDEXES
The Living IndexesThe Local LLM Index
The Local LLM Index / Quantization & Formats / #49

ddalcu/mlx-serve

by ddalcu · Quantization & Formats · updated today

Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.

70
momentum
2,392
stars
252
forks
#49
rank
agentanthropic-apiapple-siliconclaude-codedeepseek-v4diffusionggufimage-generationinferencellmlocal-llmmacos
View on GitHub →