stupid_crawler 0.2.0

Stupid crawler that looks for URLs on a given site. Result is saved as two CSV files one with found URLs and another with failed URLs.

Gemfile:
= Copy to clipboard Copied!

install:
=

Versions:

0.2.1 - September 10, 2017 (8 KB)
0.2.0 - September 10, 2017 (8 KB)

Runtime Dependencies (1):

spidr ~> 0.6

Development Dependencies (2):

bundler ~> 1.12

rake ~> 10.0

Show all transitive dependencies

Owners:

Authors:

Jacob Burenstam

SHA 256 checksum:

0c9c8026d5ce57784c001c74842a920e68dc39919a68f7bf4e3cdb74de9e97fe