npm

mrspider

simple polite crawling of the web.

mrspider-request

transform stream for mrspider

mrspider-cheerio

cheerio middleware for mrspider

mrspider-css-links

middleware for mrspider to extract links using css rules

mrspider-css-data-extractor

data extractor middleware for mrspider

mrspider-css-image-extraction

mrspider middleware to extract image urls from a webpage.

mrspider-regex-data-extractor

mrspider middleware to extract data using regular expressions.

mrspider-validator

mrspider middleware to validate data that has been extracted.

mrspider-mongodb-persister

mrspider middleware mongodb persistence

mrspider-jsdom

mrspider jsdom middleware

user-agent-string-generator

Generate a valid user agent string.

redux-ddp

ddp client component for redux

ddp_js

ddp javascript client

meteorjs-client

Meteor Client for JavaScript