livescrape

Live Scraping service using Express, Cheerio & Artoo-JS on NodeJS.

NPM Package

https://www.npmjs.com/package/livescrape

Getting Started

Install npm package by npm install livescrape and run as a service on http://localhost:3030. Call the service on http://localhost:3030/scrape with parameters url, repeatedNode and params

Example parameters:

url = "http://www.amazon.in/s/ref=sr_pg_6?rh=i%3Aaps%2Ck%3Acomputer+table&page=6&keywords=computer+table&ie=UTF8&qid=1459248975&spIA=B015W1X4A4,B015W1X45E,B01683PX36,B01683PK8Y,B019A5PKWS,B01683PPTS,B01D1N852W,B0198NC5DO&lo=apparel";
repeatedNode = '#s-results-list-atf a.s-access-detail-page';
params = {url: 'href', title: 'text', img: function(){return $(this).parent().parent().parent().find('img.s-access-image').attr('src')}, category: function(){return $(this).parent().parent().find('a.a-size-small>span.a-text-bold').text().slice(0, -1);}};

Handcrafted by Eulogik (http://eulogik.com)