The Local LLM Index / Quantization & Formats / #220
inferflow/inferflow
by inferflow · Quantization & Formats · updated 2y ago
Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
27
momentum
251
stars
25
forks
#220
rank
baichuan2bloomdeepseekfalcongemmainternlmllama2llamacppllm-inferencem2m100minicpmmistral
View on GitHub →