The Local LLM Index / Quantization & Formats / #162
KoboldAI/KoboldAI-Client
by KoboldAI · Quantization & Formats · updated 1y ago
For GGUF support, see KoboldCPP: https://github.com/LostRuins/koboldcpp
40
momentum
3,927
stars
864
forks
#162
rank