Never Patronize Mothers

    15 packages found

    Very straightforward, event driven web crawler. Features a flexible queue interface and a basic cache mechanism with extensible backend.

    published 1.1.9 3 years ago
    M
    Q
    P

    SQLite FetchQueue Implementation for Simplecrawler

    published 1.1.0 3 years ago
    M
    Q
    P
    M
    Q
    P

    Very straigntforward web crawler. Uses EventEmitter. Generates queue statistics and has a basic cache mechanism with extensible backend. This version is forked in order to add the ability to filter by referrer url

    published 0.3.1-1.2 6 years ago
    M
    Q
    P

    iSpider is a simple and fast web spider written with Nodejs!

    published 0.0.4 7 years ago
    M
    Q
    P

    MongoDB FetchQueue Implementation for Simplecrawler

    published 0.4.1 3 years ago
    M
    Q
    P

    web-spider is a simple and fast web spider written with Nodejs!

    published 0.3.1 6 years ago
    M
    Q
    P

    MongoDB queue implementation for simplecrawler

    published 1.0.1 3 years ago
    M
    Q
    P

    Very straightforward, event driven web crawler. Features a flexible queue interface and a basic cache mechanism with extensible backend.

    published 1.1.9 4 years ago
    M
    Q
    P

    Very straightforward, event driven web crawler. Features a flexible queue interface and a basic cache mechanism with extensible backend.

    published 1.2.6 4 years ago
    M
    Q
    P

    Forked version of https://github.com/ciffard/node-simplecrawler.

    published 0.5.5 7 years ago
    M
    Q
    P

    A web crawler forked from simplecrawler.

    published 0.0.2 6 years ago
    M
    Q
    P

    A web crawler forked from simplecrawler.

    published 0.0.1 7 years ago
    M
    Q
    P

    MongoDB queue for Node Simple Crawler

    published 0.1.8 8 years ago
    M
    Q
    P

    Very straightforward web crawler. Uses EventEmitter. Based on Simplecrawler but using a distributed queue system.

    published 0.1.2 7 years ago
    M
    Q
    P