mike442144


  • Crawler is a ready-to-use web spider that works with proxies, asynchrony, rate limit, configurable request pools, jQuery, and seamless HTTP/2 support.

    published 2.0.0 18 days ago
  • Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they are downloaded, asynchronously

    published 0.8.0 8 years ago
  • A library to test if a url(request) is crawled, usually used in a web crawler. Compatible with `request` and `node-crawler`

    published 3.0.0 5 years ago
  • Node.js library for the Gearman distributed job system with support for multiple servers

    published 0.10.1 8 years ago
  • asynchronous rate limiter with priority

    published 1.1.3 7 years ago
  • mof is short for Middleware of Floodesh

    published 0.1.1 8 years ago
  • cheerio wrapper for middleware of floodesh

    published 1.0.5 8 years ago
  • Floodesh is a distributed web spider/crawler written with Nodejs.

    published 0.8.19 4 years ago
  • the charset parser for middleware of floodesh

    published 0.1.0 8 years ago
  • Convert the response body to String from one encoding to another encoding

    published 0.1.4 8 years ago
  • middleware of floodesh, which rotates User-Agent automatically

    published 1.0.2 8 years ago
  • seenreq wrapper for middleware of floodesh

    published 0.0.2 8 years ago
  • the response body checker for middleware of floodesh

    published 0.1.0 8 years ago
  • the record checker for middleware of floodesh

    published 0.1.1 8 years ago
  • core library for floodesh, which contains core request, response and context class, also used for flowesh

    published 1.1.3 8 years ago
  • a cli tool for floodesh

    published 0.4.22 4 years ago
  • daemon for floodesh/flowesh process manager

    published 1.1.2 4 years ago
  • many of the utilities are useful for application

    published 0.1.0 8 years ago
  • a functional library based on ramda

    published 2.0.3 5 years ago
  • A middleware wrapped request.js module for floodesh

    published 0.1.16 6 years ago
  • A middleware wrapped Bottleneckp module for floodesh

    published 1.0.4 7 years ago
  • Store cookies in Netscape's file

    published 0.1.0 8 years ago
  • A middleware wrapped whacko module for floodesh

    published 0.0.1 8 years ago
  • proxy middleware for floodesh

    published 1.1.0 5 years ago
  • A middleware wrapped statsd client module for floodesh

    published 2.0.0 7 years ago
show more packages