Local LLM Index / local
← All tools
The Local LLM Index / On-Device & Mobile / #186

ddh0/easy-llama

by ddh0 · On-Device & Mobile · updated 3mo ago

Python package wrapping llama.cpp for on-device LLM inference

34
momentum
106
stars
7
forks
#186
rank
llamallamacppllmllmstext-generation
View on GitHub →

More in On-Device & Mobile

On-Device & Mobile#4
MNN
MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-
On-Device & Mobile#8
runanywhere-sdks
Production ready toolkit to run AI locally
On-Device & Mobile#9
MiniCPM
MiniCPM5-1B: A SOTA 1B on-device LLM, small yet powerful.
On-Device & Mobile#11
GenieX
Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few