The Local LLM Index / Quantization & Formats / #102
zhongkaifu/TensorSharp
by zhongkaifu · Quantization & Formats · updated today
A native .NET LLM inference engine for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/Linux with full GPU capability
59
momentum
243
stars
23
forks
#102
rank
aicsharpcudacuda-programmingdotnetgemmagemma4ggufinferenceinference-enginellmmetal
View on GitHub →