Crawler
Simple site crawler for node.js
Install
npm install site-crawler
Example Codes
var Crawler = var site = 'https://techcrunch.com' var crawler = // default is 10 concurrency:10crawlercrawlerstartsite
Tests
cd crawler
npm test
Licence
MIT