mike442144


  • Crawler is a ready-to-use web spider that works with proxies, asynchrony, rate limit, configurable request pools, jQuery, and HTTP/2 support.

    published version 2.0.2, a year ago
  • Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they are downloaded, asynchronously

    published version 0.8.0, 9 years ago
  • A library to test if a url(request) is crawled, usually used in a web crawler. Compatible with `request` and `node-crawler`

    published version 3.0.0, 6 years ago
  • Node.js library for the Gearman distributed job system with support for multiple servers

    published version 0.10.1, 9 years ago
  • asynchronous rate limiter with priority

    published version 1.1.3, 8 years ago
  • mof is short for Middleware of Floodesh

    published version 0.1.1, 9 years ago
  • cheerio wrapper for middleware of floodesh

    published version 1.0.5, 9 years ago
  • Floodesh is a distributed web spider/crawler written with Nodejs.

    published version 0.8.19, 5 years ago
  • the charset parser for middleware of floodesh

    published version 0.1.0, 9 years ago
  • Convert the response body to String from one encoding to another encoding

    published version 0.1.4, 9 years ago
  • middleware of floodesh, which rotates User-Agent automatically

    published version 1.0.2, 9 years ago
  • seenreq wrapper for middleware of floodesh

    published version 0.0.2, 9 years ago
  • the response body checker for middleware of floodesh

    published version 0.1.0, 9 years ago
  • the record checker for middleware of floodesh

    published version 0.1.1, 9 years ago
  • core library for floodesh, which contains core request, response and context class, also used for flowesh

    published version 1.1.3, 9 years ago
  • a cli tool for floodesh

    published version 0.4.22, 5 years ago
  • daemon for floodesh/flowesh process manager

    published version 1.1.2, 5 years ago
  • many of the utilities are useful for application

    published version 0.1.0, 9 years ago
  • a functional library based on ramda

    published version 2.0.3, 6 years ago
  • A middleware wrapped request.js module for floodesh

    published version 0.1.16, 7 years ago
  • A middleware wrapped Bottleneckp module for floodesh

    published version 1.0.4, 8 years ago
  • Store cookies in Netscape's file

    published version 0.1.0, 9 years ago
  • A middleware wrapped whacko module for floodesh

    published version 0.0.1, 9 years ago
  • proxy middleware for floodesh

    published version 1.1.0, 6 years ago
  • A middleware wrapped statsd client module for floodesh

    published version 2.0.0, 8 years ago
show more packages