Nefarious Pomegranate Magnate

    @harshad1011/product-scraper

    1.0.1 • Public • Published

    product-scraper

    Description

    This npm is developed for basic scraping of E-Commerce platforms like Grofers, Big Basket, Nature's Basket. It can also be used for customized scraping of any URL, given the json object. See examples for explaination.

    APIs

    1. productScraper: This API takes 3 parameters.
      • First parameter is url in string type.
      • Second parameter is meta-data, which is used to scrape custom data from given url. This parameter is optional.
      • Third parameter is callback function to which takes argument error & data.`

    Examples

    Running npm via command line

    node index.js -u http://www.naturesbasket.co.in/Products/Organic-Tulsi-Green-Tea---25-TB---Organic-India/4054_0_0_0 -p
    

    Install npm via command line

    npm install @harshad1011/product-scraper --save
    

    Importing npm as a node module:

    var ps = require('@harshad1011/product-scraper');
    ps.productScraper("https://grofers.com/prn/bitter-gourd-karela/prid/197969", {
        "name": ".LinesEllipsis",
        "price": ".pdp-product__price--new"
    }, function (err, data) {
        if (err) {
            console.error(err);
        } else if (data) {
            Object.keys(data).forEach(function (key) {
                console.log(data[key]);
            });
        } else {
            console.error("No response received");
        }
    });
    

    Limitations

    This npm doesn't work well with dynamic pages. Feel free to suggest changes.

    Install

    npm i @harshad1011/product-scraper

    DownloadsWeekly Downloads

    0

    Version

    1.0.1

    License

    MIT

    Unpacked Size

    11.3 kB

    Total Files

    8

    Last publish

    Collaborators

    • harshad1011