The Local LLM Index / Quantization & Formats / #136
jegly/OfflineLLM
by jegly · Quantization & Formats · updated 25d ago
Private on-device AI chat for Android — runs any GGUF model locally via llama.cpp with ARM-optimised SIMD. Zero network permissions, encrypted settings, biometric lock, tamper detection. + GPU Acceleration
54
momentum
236
stars
21
forks
#136
rank
androidandroid-aiandroid-ai-appandroid-llmartificial-intelligenceedge-aigemma4generative-aillamacppllmlocal-ailocal-llm
View on GitHub →