The Local LLM Index / Quantization & Formats / #141
gianlucamazza/xllama
by gianlucamazza · Quantization & Formats · updated today
Local LLM inference on Xbox Series S in Developer Mode: llama.cpp (GGUF) + ONNX Runtime GenAI, an OpenAI-compatible LAN endpoint (off by default), SD-Turbo image generation and experimental on-device fine-tuning. Not yet tested on Series X. Independent project, not affiliated with Microsoft.
54
momentum
82
stars
10
forks
#141
rank
cppdirectmlgame-consoleggufhuggingfacellama-cppllmlocal-inferenceonnxruntimeuwpxbox
View on GitHub →