The Local LLM Index / Quantization & Formats / #63

Kaden-Schutt/hipfire

by Kaden-Schutt · Quantization & Formats · updated today

RDNA-native LLM inference engine in Rust.

66
momentum
431
stars
46
forks
#63
rank
amd-gpugpu-computinghipllm-inferencemachine-learningquantizationrdnarocmrust
View on GitHub →