@harshad1011/product-scraper

1.0.1 • Public • Published

product-scraper

Description

This npm is developed for basic scraping of E-Commerce platforms like Grofers, Big Basket, Nature's Basket. It can also be used for customized scraping of any URL, given the json object. See examples for explaination.

APIs

  1. productScraper: This API takes 3 parameters.
    • First parameter is url in string type.
    • Second parameter is meta-data, which is used to scrape custom data from given url. This parameter is optional.
    • Third parameter is callback function to which takes argument error & data.`

Examples

Running npm via command line

node index.js -u http://www.naturesbasket.co.in/Products/Organic-Tulsi-Green-Tea---25-TB---Organic-India/4054_0_0_0 -p

Install npm via command line

npm install @harshad1011/product-scraper --save

Importing npm as a node module:

var ps = require('@harshad1011/product-scraper');
ps.productScraper("https://grofers.com/prn/bitter-gourd-karela/prid/197969", {
    "name": ".LinesEllipsis",
    "price": ".pdp-product__price--new"
}, function (err, data) {
    if (err) {
        console.error(err);
    } else if (data) {
        Object.keys(data).forEach(function (key) {
            console.log(data[key]);
        });
    } else {
        console.error("No response received");
    }
});

Limitations

This npm doesn't work well with dynamic pages. Feel free to suggest changes.

Versions

Current Tags

  • Version
    Downloads (Last 7 Days)
    • Tag
  • 1.0.1
    1
    • latest

Version History

  • Version
    Downloads (Last 7 Days)
    • Published
  • 1.0.1
    1
  • 1.0.0
    0

Package Sidebar

Install

npm i @harshad1011/product-scraper

Weekly Downloads

1

Version

1.0.1

License

MIT

Unpacked Size

11.3 kB

Total Files

8

Last publish

Collaborators

  • harshad1011