The Local LLM Index / On-Device & Mobile / #4
alibaba/MNN
by alibaba · On-Device & Mobile · updated today
MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
79
momentum
15,741
stars
2,392
forks
#4
rank
armconvolutiondeep-learningembedded-devicesllmmachine-learningmlmnntransformervulkanwinograd-algorithm
View on GitHub →