The Local LLM Index / Quantization & Formats / #164

docusealco/rllama

by docusealco · Quantization & Formats · updated 1mo ago

Ruby FFI bindings for llama.cpp to run open-source LLMs such as GPT-OSS, Qwen 3.5, Gemma 4, and Llama 3 locally with Ruby.

44
momentum
92
stars
3
forks
#164
rank
aiembeddingsffiggufinferencellamacppllmruby
View on GitHub →