The Local LLM Index / On-Device & Mobile / #4
alibaba/MNN
by alibaba · On-Device & Mobile · updated 1d ago
MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
79
momentum
15,475
stars
2,351
forks
#4
rank
armconvolutiondeep-learningembedded-devicesllmmachine-learningmlmnntransformervulkanwinograd-algorithm
View on GitHub →