RubyGems Navigation menu

spider 0.5.1

A Web spidering library: handles robots.txt, scraping, finding more links, and doing it all over again.

Gemfile:
=

install:
=

Versions:

  1. 0.7.0 September 08, 2025 (10 KB)
  2. 0.6.0 September 08, 2025 (10 KB)
  3. 0.5.4 June 04, 2020 (15.5 KB)
  4. 0.5.3 April 23, 2018 (15 KB)
  5. 0.5.2 April 23, 2018 (15 KB)
  6. 0.5.1 September 04, 2016 (15 KB)
Show all versions (16 total)

Owners:

Authors:

  • John Nagro

SHA 256 checksum:

=
← Previous version Next version →

Total downloads 470,139

For this version 23,773

Version Released:

License:

MIT

Required Ruby Version: >= 0

Links:

Homepage Documentation Download Review changes Badge Subscribe RSS Report abuse Reverse dependencies