Search results

15 packages found

Very straightforward, event driven web crawler. Features a flexible queue interface and a basic cache mechanism with extensible backend.

published 1.1.9 4 years ago
M
Q
P

MongoDB FetchQueue Implementation for Simplecrawler

published 0.4.1 4 years ago
M
Q
P

Very straightforward, event driven web crawler. Features a flexible queue interface and a basic cache mechanism with extensible backend.

published 1.2.6 5 years ago
M
Q
P

MongoDB queue implementation for simplecrawler

published 1.0.1 5 years ago
M
Q
P

Very straightforward, event driven web crawler. Features a flexible queue interface and a basic cache mechanism with extensible backend.

published 1.1.9 6 years ago
M
Q
P

SQLite FetchQueue Implementation for Simplecrawler

published 1.1.0 5 years ago
M
Q
P

web-spider is a simple and fast web spider written with Nodejs!

published 0.3.1 8 years ago
M
Q
P

Forked version of https://github.com/ciffard/node-simplecrawler.

published 0.5.5 8 years ago
M
Q
P

A web crawler forked from simplecrawler.

published 0.0.2 8 years ago
M
Q
P

A web crawler forked from simplecrawler.

published 0.0.1 8 years ago
M
Q
P
M
Q
P

Very straigntforward web crawler. Uses EventEmitter. Generates queue statistics and has a basic cache mechanism with extensible backend. This version is forked in order to add the ability to filter by referrer url

published 0.3.1-1.2 8 years ago
M
Q
P

Very straightforward web crawler. Uses EventEmitter. Based on Simplecrawler but using a distributed queue system.

published 0.1.2 8 years ago
M
Q
P

iSpider is a simple and fast web spider written with Nodejs!

published 0.0.4 8 years ago
M
Q
P

MongoDB queue for Node Simple Crawler

published 0.1.8 10 years ago
M
Q
P