The Local LLM Index / Quantization & Formats / #149

gianlucamazza/xllama

by gianlucamazza · Quantization & Formats · updated today

Local LLM inference on Xbox Series S|X in Dev Mode: llama.cpp (GGUF) + ONNX Runtime GenAI, opt-in OpenAI-compatible LAN endpoint, diffusion and on-device training. Measured models are listed in a Hugging Face collection. Independent research project, not affiliated with Microsoft.

51
momentum
53
stars
7
forks
#149
rank
cppdirectmlgame-consoleggufhuggingfacellama-cppllmlocal-inferenceonnxruntimeuwpxbox
View on GitHub →