The Local LLM Index / Quantization & Formats / #97

jegly/OfflineLLM

by jegly · Quantization & Formats · updated 15d ago

Private on-device AI chat for Android — runs any GGUF model locally via llama.cpp with ARM-optimised SIMD. Zero network permissions, encrypted settings, biometric lock, tamper detection.

60
momentum
170
stars
13
forks
#97
rank
androidandroid-aiandroid-ai-appandroid-llmartificial-intelligenceedge-aigemma4generative-aillamacppllmlocal-ailocal-llm
View on GitHub →