The Local LLM Index / On-Device & Mobile / #11
StayLameBro/backburner
by StayLameBro · On-Device & Mobile · updated today
Your iPhone helps your Mac run a 27B model: faster prompt reading and more context over a USB-C cable
77
momentum
992
stars
104
forks
#11
rank
apple-siliconiosiphonellama-cppllm-inferencelocal-llmmacosmetalqwensme2speculative-decoding
View on GitHub →