The Local LLM Index / On-Device & Mobile / #12
google-ai-edge/LiteRT-LM
by google-ai-edge · On-Device & Mobile · updated today
LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
75
momentum
6,041
stars
652
forks
#12
rank
edge-aion-device-aion-device-llm
View on GitHub →