mike442144
Crawler is a ready-to-use web spider that works with proxies, asynchrony, rate limit, configurable request pools, jQuery, and HTTP/2 support.
published version 2.0.2, a year agoCrawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they are downloaded, asynchronously
published version 0.8.0, 9 years agoA library to test if a url(request) is crawled, usually used in a web crawler. Compatible with `request` and `node-crawler`
published version 3.0.0, 6 years agoNode.js library for the Gearman distributed job system with support for multiple servers
published version 0.10.1, 9 years agoFloodesh is a distributed web spider/crawler written with Nodejs.
published version 0.8.19, 5 years agothe charset parser for middleware of floodesh
published version 0.1.0, 9 years agoConvert the response body to String from one encoding to another encoding
published version 0.1.4, 9 years agomiddleware of floodesh, which rotates User-Agent automatically
published version 1.0.2, 9 years agothe response body checker for middleware of floodesh
published version 0.1.0, 9 years agocore library for floodesh, which contains core request, response and context class, also used for flowesh
published version 1.1.3, 9 years agodaemon for floodesh/flowesh process manager
published version 1.1.2, 5 years agoA middleware wrapped request.js module for floodesh
published version 0.1.16, 7 years agoA middleware wrapped Bottleneckp module for floodesh
published version 1.0.4, 8 years agoStore cookies in Netscape's file
published version 0.1.0, 9 years agoA middleware wrapped whacko module for floodesh
published version 0.0.1, 9 years agoA middleware wrapped statsd client module for floodesh
published version 2.0.0, 8 years ago
