ruby_llm-red_candle 0.2.0
A RubyLLM plugin that enables local LLM execution using the Red Candle gem. Run quantized GGUF models directly in Ruby without external API calls. Supports streaming, structured output, and multiple model architectures including Gemma, Llama, Qwen, Mistral, and Phi.
Gemfile:
=
installieren:
=
Runtime Abhängigkeiten (2):
red-candle
~> 1.5
ruby_llm
>= 1.10, < 3.0
Development Abhängigkeiten (5):
Besitzer:
Pushed by:
Autoren:
-
Chris Petersen
SHA 256-Prüfsumme:
=