The Local LLM Index / Quantization & Formats / #87
SharpAI/SwiftLM
by SharpAI · Quantization & Formats · updated 6d ago
⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.
63
momentum
765
stars
53
forks
#87
rank
apple-siliinferenceiosllmmetalmlxmoeon-device-aiopenai-apiswift
View on GitHub →