Packages 34
Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they are downloaded, asynchronously
published 1.4.0 3 months agoCrawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they are downloaded, asynchronously
published 0.8.0 6 years agoA library to test if a url(request) is crawled, usually used in a web crawler. Compatible with `request` and `node-crawler`
published 3.0.0 4 years agoNode.js library for the Gearman distributed job system with support for multiple servers
published 0.10.1 6 years agoFloodesh is a distributed web spider/crawler written with Nodejs.
published 0.8.19 3 years agoConvert the response body to String from one encoding to another encoding
published 0.1.4 6 years agomiddleware of floodesh, which rotates User-Agent automatically
published 1.0.2 6 years agocore library for floodesh, which contains core request, response and context class, also used for flowesh
published 1.1.3 6 years agoA middleware wrapped request.js module for floodesh
published 0.1.16 5 years agoA middleware wrapped Bottleneckp module for floodesh
published 1.0.4 6 years agoA middleware wrapped statsd client module for floodesh
published 2.0.0 6 years ago