The Local LLM Index / On-Device & Mobile / #7
alibaba/MNN
by alibaba · On-Device & Mobile · updated 1d ago
MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
79
momentum
16,069
stars
2,436
forks
#7
rank
armconvolutiondeep-learningembedded-devicesllmmachine-learningmlmnntransformervulkanwinograd-algorithm
View on GitHub →