Dépendances inversées pour tokenizers Latest version of the following gems require tokenizers

informers 1.2.1

Fast transformer inference for Ruby

2 418 955 Téléchargements

discourse_ai-tokenizers 0.4.2

A Ruby gem providing a consistent interface for various AI/ML tokenizers including Open...

227 650 Téléchargements

llm_memory 0.1.15

LLM Memory is a Ruby gem designed to provide large language models (LLMs) like ChatGPT ...

22 501 Téléchargements

clip-rb 2.0.0

OpenAI CLIP embeddings, uses ONNX models. Allows to create embeddings for images and text

6 386 Téléchargements

transformers-rb 0.2.0

State-of-the-art transformers for Ruby

4 394 Téléchargements

gliner 0.3.1

Basic Ruby inference wrapper for the GLiNER2 ONNX model.

2 269 Téléchargements

vectorsearch 0.1.2

Vector Search backed by your vector search DB of choice.

1 955 Téléchargements

token_estimator 0.1.2

TokenEstimator is a Rails gem that allows you to count tokens in Excel, CSV, PDF, TXT, ...

1 429 Téléchargements

fastembed 1.1.0

A Ruby port of FastEmbed - fast text embeddings using ONNX Runtime

1 213 Téléchargements

mlx-ruby-lm 0.30.7.1

A Ruby port of mlx-lm providing large language model inference, quantization, LoRA fine...

728 Téléchargements

prompt_guard 1.0.2

Security pipelines for LLM applications using ONNX models from Hugging Face Hub. Detect...

588 Téléchargements

fine 0.2.0

A Ruby-native interface for fine-tuning machine learning models, starting with image cl...

525 Téléchargements

siglip2 1.0.0

Ruby implementation of Google's SigLIP2 model for creating text and image embeddings. U...

461 Téléchargements

llm-lsp 0.2.1

Ruby LSP server that provides code completion using LLM FIM (Fill-In-the-Middle). Suppo...

389 Téléchargements

nanochat 0.1.0.pre

A minimal, hackable LLM implementation with inference capabilities. Port of Karpathy's ...

233 Téléchargements

kiribi-ruri_v3-30m 0.0.3

Easy to use some onnx models.

199 Téléchargements

kiribi-gemma4_e2b 0.0.1