The Local LLM Index / Quantization & Formats / #126
jegly/OfflineLLM
by jegly · Quantization & Formats · updated today
Private on-device AI chat for Android — runs any GGUF model locally via llama.cpp with ARM-optimised SIMD. Zero network permissions, encrypted settings, biometric lock, tamper detection. + GPU Acceleration - PQC ML-DSA-87 signed releases
59
momentum
274
stars
28
forks
#126
rank
androidandroid-aiandroid-ai-appandroid-llmartificial-intelligenceedge-aigemma4generative-aillamacppllmlocal-ailocal-llm
View on GitHub →