The Local LLM Index / Quantization & Formats / #156
KoboldAI/KoboldAI-Client
by KoboldAI · Quantization & Formats · updated 1y ago
For GGUF support, see KoboldCPP: https://github.com/LostRuins/koboldcpp
40
momentum
3,911
stars
859
forks
#156
rank