The Local LLM Index / Quantization & Formats / #132

llamatik/Llamatik

by llamatik · Quantization & Formats · updated 3d ago

True on-device AI SDK for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). LLM inference, Speech-to-Text, Image Generation, Agent Framework and RAG — powered by llama.cpp, whisper.cpp and stable-diffusion.cpp.

58
momentum
207
stars
38
forks
#132
rank
aiandroiddesktopedge-aiggmlinferenceioskmpkmp-librarykotlinktorllama
View on GitHub →