crawlr 0.2.3

Crawlr is a modern Ruby web scraping framework built for respectful and efficient data extraction. Features async HTTP requests, robots.txt compliance, cookie management, proxy rotation, flexible CSS/XPath selectors, and comprehensive error handling. Designed for both simple scraping tasks and complex, large-scale data extraction projects.

Gemfile:
=

installieren:
=

Versionen:

0.2.3 October 03, 2025 (31,5 KB)
0.2.2 October 01, 2025 (31,5 KB)
0.2.1 September 30, 2025 (31 KB)
0.2.0 September 29, 2025 (31 KB)
0.1.0 September 29, 2025 (30,5 KB)

Runtime Abhängigkeiten (5):

async ~> 2.32

async-http ~> 0.91.0

concurrent-ruby ~> 1.3

http-cookie ~> 1.0

nokogiri ~> 1.18

Development Abhängigkeiten (5):

rake ~> 13.0

rspec ~> 3.0

rubocop ~> 1.60

ruby-prof ~> 1.7

webmock ~> 3.25

Alle transitiven Abhängigkeiten anzeigen

Besitzer:

Pushed by:

Autoren:

Aristotelis Rapai

SHA 256-Prüfsumme:

Downloads insgesamt 1.001

Für diese Version 162

Version veröffentlicht:
October 3, 2025 5:08pm

Lizenz:
MIT

Erforderliche Ruby-Version: >= 3.1.0

New versions require MFA: true

Version published with MFA: true

Links:

Homepage Changelog Bug Tracker Download Review changes Abzeichen RSS Missbrauch melden Reverse dependencies