ruby_llm-red_candle 0.2.0
A RubyLLM plugin that enables local LLM execution using the Red Candle gem. Run quantized GGUF models directly in Ruby without external API calls. Supports streaming, structured output, and multiple model architectures including Gemma, Llama, Qwen, Mistral, and Phi.
Gemfile:
=
Installeer:
=
Runtime afhankelijkheden (2):
red-candle
~> 1.5
ruby_llm
>= 1.10, < 3.0
Development afhankelijkheden (5):
Eigenaren:
Pushed by:
Authors:
-
Chris Petersen
SHA 256 checksum:
=