The Local LLM Index / Quantization & Formats / #172
KoboldAI/KoboldAI-Client
by KoboldAI · Quantization & Formats · updated 1y ago
For GGUF support, see KoboldCPP: https://github.com/LostRuins/koboldcpp
40
momentum
3,944
stars
861
forks
#172
rank