A multilingual tokenizer to split a string into tokens.
Required Ruby Version
>= 0
Authors
Kevin S. Dias
Versions
- 3.2.1 August 11, 2024 (71 KB)
- 3.2.0 November 29, 2020 (71 KB)
- 3.1.0 July 10, 2020 (70.5 KB)
- 3.0.7 March 18, 2018 (70.5 KB)
- 3.0.6 March 15, 2018 (72.5 KB)
- 0.2.2 January 12, 2016 (50 KB)