The Local LLM Index / Quantization & Formats / #102
zhongkaifu/TensorSharp
by zhongkaifu · Quantization & Formats · updated today
A native .NET LLM inference engine for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/iOS/Linux with full GPU capability
62
momentum
428
stars
45
forks
#102
rank
aicsharpcudacuda-programmingdeepseek-v4dotnetdsparkgemmagemma4ggufglminference
View on GitHub →