The Local LLM Index / On-Device & Mobile / #17
google-ai-edge/LiteRT-LM
by google-ai-edge · On-Device & Mobile · updated today
LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
75
momentum
6,427
stars
717
forks
#17
rank
edge-aion-device-aion-device-llm
View on GitHub →