The Local LLM Index / Quantization & Formats / #100
zhongkaifu/TensorSharp
by zhongkaifu · Quantization & Formats · updated today
A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/iOS/Linux with full GPU capability
63
momentum
630
stars
65
forks
#100
rank
aicsharpcudadeepseekdotnetdsparkgemmagemma4ggufglminferenceinference-engine
View on GitHub →