The Local LLM Index / On-Device & Mobile / #235
Gygeek/Framework-strix-halo-llm-setup
by Gygeek · On-Device & Mobile · updated 9mo ago
Complete guide to running large language models locally on AMD Ryzen AI Max+ 395 (Strix Halo) with 128GB unified memory. Covers BIOS config, kernel setup, ROCm installation, and llama.cpp deployment. Run 70B+ parameter models on a single APU.
23
momentum
113
stars
9
forks
#235
rank