The Local LLM Index / Inference Engines / #92

zolotukhin/zinc

by zolotukhin · Inference Engines · updated 6d ago

Zig INferenCe Engine — Local LLM inference on AMD GPUs and Apple Silicon

61
momentum
488
stars
20
forks
#92
rank
amdamdgpugptgpuopenaipytorchqwen3rdna3rdna4transformerzig
View on GitHub →