Local LLM Index / local
← All tools
The Local LLM Index / On-Device & Mobile / #5

drumih/turbo-fieldfare

by drumih · On-Device & Mobile · updated 4d ago

Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

81
momentum
6,712
stars
425
forks
#5
rank
apple-silicongemmagemma4gemma4-26b-a4bgpgpullmllm-inferencelocal-aimacosmetalon-device-aion-device-llm
View on GitHub →

More in On-Device & Mobile

On-Device & Mobile#7
MNN
MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-
On-Device & Mobile#9
needle
14MB foundation model for tiny devices; phones, wearables, smart home, and robots.
On-Device & Mobile#10
MiniCPM
MiniCPM5: SOTA on-device LLMs, small yet powerful.
On-Device & Mobile#11
runanywhere-sdks
Production ready toolkit to run AI locally