tokenizers 的反向依賴 下列 Gems 的最新版本需要 tokenizers
informers 1.2.1
Fast transformer inference for Ruby
2,340,006 下載
discourse_ai-tokenizers 0.3.2
A Ruby gem providing a consistent interface for various AI/ML tokenizers including Open...
83,095 下載
llm_memory 0.1.15
LLM Memory is a Ruby gem designed to provide large language models (LLMs) like ChatGPT ...
20,421 下載
clip-rb 2.0.0
OpenAI CLIP embeddings, uses ONNX models. Allows to create embeddings for images and text
5,072 下載
transformers-rb 0.1.6
State-of-the-art transformers for Ruby
3,626 下載
vectorsearch 0.1.2
Vector Search backed by your vector search DB of choice.
1,812 下載
token_estimator 0.1.2
TokenEstimator is a Rails gem that allows you to count tokens in Excel, CSV, PDF, TXT, ...
1,293 下載
kiribi-multilingual_e5-small 0.0.2
Easy to use some onnx models.
479 下載
nanochat 0.1.0.pre
A minimal, hackable LLM implementation with inference capabilities. Port of Karpathy's ...
164 下載