The Local LLM Index / On-Device & Mobile / #231
Gygeek/Framework-strix-halo-llm-setup
by Gygeek · On-Device & Mobile · updated 7mo ago
Complete guide to running large language models locally on AMD Ryzen AI Max+ 395 (Strix Halo) with 128GB unified memory. Covers BIOS config, kernel setup, ROCm installation, and llama.cpp deployment. Run 70B+ parameter models on a single APU.
23
momentum
106
stars
7
forks
#231
rank