OpenBMB/MiniCPM

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-

Production ready toolkit to run AI locally

Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework