bauer-crawler-scrape
Plugin for bauer-crawler
to make http requests.
Installation
npm install bauer-crawler-scrape
Usage
module { return promise;};
module { return promise ;};
Configuration
workers: 1 slots: 1 delay: 0 cache: // default options for bauer-cache json: false expires: "1d" file: dir: "." ext: "txt"
API Summary
Promise
.scrape(scrape Object) :Promise
.scrape(source String, scrape Object) :Promise