rspec-llm adds first-class RSpec support for testing Large Language Model interactions. Ships LLM-as-judge matchers, JSON Schema validation, semantic similarity matchers, a programmable fake adapter, and a thin DSL for batch evaluations. Works with the ruby_llm and langchainrb gems out of the box.
Required Ruby Version
>= 3.3.0
Authors
Sal Scotto