The Local LLM Index / Quantization & Formats / #235
arm-education/Advanced-AI-Hardware-Software-Co-Design
by arm-education · Quantization & Formats · updated 6mo ago
Hands-on course materials for ML engineers to master extreme model quantization and on-device LLM deployment: PyTorch, llama.cpp, Android (educational)
18
momentum
38
stars
9
forks
#235
rank
armcourseedge-aigenaihardware-aware-optimizationllama-cppllmmodel-compressionnotebookspythonpytorchqat
View on GitHub →