llm.rb is Ruby's capable AI runtime. It runs on Ruby's standard library by default. loads optional pieces only when needed, and offers a single runtime for providers, agents, tools, skills, MCP, A2A (Agent2Agent), RAG (vector stores & embeddings), streaming, files, and persisted state. As a bonus, llm.rb is also available for mruby. It supports OpenAI, OpenAI-compatible endpoints, Anthropic, Google Gemini, DeepSeek, xAI, Z.ai, AWS Bedrock, Ollama, and llama.cpp. It also includes built-in ActiveRecord and Sequel support, plus concurrent tool execution through threads, tasks (via async gem), fibers, ractors, and fork (via xchan.rb gem).
Required Ruby Version
>= 3.3.0
Authors
Robert (0x1eef), Antar Azri, Rodrigo Serrano
Versions
- 12.2.0 July 10, 2026 (195 KB)
- 12.1.0 July 06, 2026 (192 KB)
- 12.0.0 June 30, 2026 (180 KB)
- 11.3.1 June 21, 2026 (169 KB)
- 11.3.0 June 14, 2026 (165 KB)