The Local LLM Index / Inference Engines / #99

zolotukhin/zinc

by zolotukhin · Inference Engines · updated today

Zig INferenCe Engine — Local LLM inference on AMD GPUs and Apple Silicon

62
momentum
514
stars
21
forks
#99
rank
amdamdgpugptgpuopenaipytorchqwen3rdna3rdna4transformerzig
View on GitHub →