The Local LLM Index / On-Device & Mobile / #6
alibaba/MNN
by alibaba · On-Device & Mobile · updated today
MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
79
momentum
16,296
stars
2,490
forks
#6
rank
armconvolutiondeep-learningembedded-devicesllmmachine-learningmlmnntransformervulkanwinograd-algorithm
View on GitHub →