RubyGems Navigation menu

j_r_r_token 1.1.0-x86_64-darwin

JRRToken is a Ruby gem that wraps the tiktoken Rust library, enabling fast and efficient tokenization for OpenAI models. It supports multiple models including o200k_base, cl100k_base, p50k_base, p50k_edit, and r50k_base.

Gemfile:
=

install:
=

Versions:

  1. 1.2.1 May 13, 2026 x86_64-linux (24.5 MB)
  2. 1.2.1 May 13, 2026 arm64-darwin (23.8 MB)
  3. 1.2.1 May 13, 2026 x86_64-darwin (23.8 MB)
  4. 1.2.1 May 13, 2026 x86_64-linux-musl (24.5 MB)
  5. 1.2.1 May 13, 2026 aarch64-linux (24.2 MB)
  6. 1.1.0 August 27, 2025 x86_64-darwin (23.9 MB)
Show all versions (41 total)

Development Dependencies (3):

bundler >= 2.0
rake ~> 13.0
rake-compiler >= 0
Show all transitive dependencies

Owners:

Pushed by:

Authors:

  • Logan Bresnahan

SHA 256 checksum:

=
← Previous version Next version →

Total downloads 11,783

For this version 281

Version Released:

License:

MIT

Required Ruby Version: >= 2.7, < 3.5.dev

Required Rubygems Version: >= 3.0.0

Links:

Homepage Changelog Download Review changes Badge Subscribe RSS Analytics Report abuse Reverse dependencies