15 packages found

M
Q
P

Description

Very straightforward, event driven web crawler. Features a flexible queue interface and a basic cache mechanism with extensible backend.

Keywords

Publisher

published 1.1.93 months ago
M
Q
P

Description

SQLite FetchQueue Implementation for Simplecrawler

Keywords

Publisher

published 1.1.08 months ago
M
Q
P

Description

MongoDB FetchQueue Implementation for Simplecrawler

Keywords

Publisher

published 0.4.14 months ago
M
Q
P

Description

MongoDB queue implementation for simplecrawler

Keywords

Publisher

published 1.0.18 months ago
M
Q
P
M
Q
P

Description

Very straigntforward web crawler. Uses EventEmitter. Generates queue statistics and has a basic cache mechanism with extensible backend. This version is forked in order to add the ability to filter by referrer url

Keywords

Publisher

published 0.3.1-1.24 years ago
M
Q
P

Description

Very straightforward, event driven web crawler. Features a flexible queue interface and a basic cache mechanism with extensible backend.

Keywords

Publisher

published 1.2.6a year ago
M
Q
P

Description

web-spider is a simple and fast web spider written with Nodejs!

Keywords

Publisher

published 0.3.14 years ago
M
Q
P

Description

iSpider is a simple and fast web spider written with Nodejs!

Keywords

Publisher

published 0.0.44 years ago
M
Q
P

Description

Very straightforward, event driven web crawler. Features a flexible queue interface and a basic cache mechanism with extensible backend.

Keywords

Publisher

published 1.1.92 years ago
M
Q
P

Description

Forked version of https://github.com/ciffard/node-simplecrawler.

Keywords

Publisher

published 0.5.54 years ago
M
Q
P

Description

A web crawler forked from simplecrawler.

Keywords

Publisher

published 0.0.24 years ago
M
Q
P

Description

A web crawler forked from simplecrawler.

Keywords

Publisher

published 0.0.14 years ago
M
Q
P

Description

MongoDB queue for Node Simple Crawler

Keywords

Publisher

published 0.1.86 years ago
M
Q
P

Description

Very straightforward web crawler. Uses EventEmitter. Based on Simplecrawler but using a distributed queue system.

Keywords

Publisher

published 0.1.24 years ago