arachnid 0.4.1

Arachnid is a web crawler that relies on Bloom Filters to efficiently store visited urls and Typhoeus to avoid the overhead of Mechanize when crawling every page on a domain.

Gemfile:
=

installieren:
=

Versionen:

0.4.1 January 17, 2014 (5 KB)
0.4.0 January 16, 2014 (4,5 KB)
0.3.2 January 16, 2014 (5 KB)
0.3.1 January 16, 2014 (5 KB)
0.3.0 January 16, 2014 (4,5 KB)

Zeige alle Versionen (12 total)

Runtime Abhängigkeiten (4):

bloomfilter-rb = 2.1.1

domainatrix >= 0

nokogiri = 1.5.0

typhoeus = 0.3.2

Alle transitiven Abhängigkeiten anzeigen

Besitzer:

Autoren:

dchuk

SHA 256-Prüfsumme:

Downloads insgesamt 52.118

Für diese Version 4.861

Version veröffentlicht:
January 17, 2014 6:36pm

Lizenzen:
k.A.

Erforderliche Ruby-Version: None

Links:

Homepage Dokumentation Download Review changes Abzeichen RSS Missbrauch melden Reverse dependencies