mike442144
Packages 30
Description
Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they are downloaded, asynchronously
Publisher
Description
Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they are downloaded, asynchronously
Publisher
Description
A library to test if a url(request) is crawled, usually used in a web crawler. Compatible with `request` and `node-crawler`
Publisher
Description
Node.js library for the Gearman distributed job system with support for multiple servers
Publisher
Description
cheerio wrapper for middleware of floodesh
Publisher
Description
Floodesh is a distributed web spider/crawler written with Nodejs.
Publisher
Description
the charset parser for middleware of floodesh
Publisher
Description
Convert the response body to String from one encoding to another encoding
Publisher
Description
middleware of floodesh, which rotates User-Agent automatically
Publisher
Description
seenreq wrapper for middleware of floodesh
Publisher
Description
the response body checker for middleware of floodesh
Publisher
Description
the record checker for middleware of floodesh
Publisher
Description
core library for floodesh, which contains core request, response and context class, also used for flowesh
Publisher
Description
daemon for floodesh/flowesh process manager
Publisher
Description
many of the utilities are useful for application
Publisher
Description
A middleware wrapped request.js module for floodesh
Publisher
Description
A middleware wrapped Bottleneckp module for floodesh
Publisher
Description
Store cookies in Netscape's file
Publisher
Description
A middleware wrapped whacko module for floodesh
Publisher
Description
A middleware wrapped statsd client module for floodesh