The Local LLM Index / Quantization & Formats / #41
KoboldAI/KoboldAI-Client
by KoboldAI · Quantization & Formats · updated 13d ago
For GGUF support, see KoboldCPP: https://github.com/LostRuins/koboldcpp
70
momentum
3,958
stars
860
forks
#41
rank