The Local LLM Index / On-Device & Mobile / #229
Gygeek/Framework-strix-halo-llm-setup
by Gygeek · On-Device & Mobile · updated 6mo ago
Complete guide to running large language models locally on AMD Ryzen AI Max+ 395 (Strix Halo) with 128GB unified memory. Covers BIOS config, kernel setup, ROCm installation, and llama.cpp deployment. Run 70B+ parameter models on a single APU.
22
momentum
94
stars
4
forks
#229
rank