The Local LLM Index / On-Device & Mobile / #13

google-ai-edge/LiteRT-LM

by google-ai-edge · On-Device & Mobile · updated today

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

74
momentum
5,572
stars
573
forks
#13
rank
edge-aion-device-aion-device-llm
View on GitHub →