The Local LLM Index / On-Device & Mobile / #109
leonickson1/Swiftlet
by leonickson1 · On-Device & Mobile · updated 1mo ago
Swiftlet is a Swift and Metal runtime that runs large Qwen Mixture-of-Experts models locally on Apple devices by streaming expert weights from storage, enabling 35B and 80B models to run with low RAM, including on iPhone.
61
momentum
664
stars
40
forks
#109
rank
local-llmmixture-of-expertson-device-aiqwenswift
View on GitHub →