Share your code. npm Orgs help your team discover, share, and reuse code. Create a free org »

    alphabitspublic

    Alphabits

    Scrape a number of pages asynchronously and write out your data in one file when done. It generally assumes that you are scraping a series of webpages whose urls vary by a different parameter.

    Can output json (default) or csv if json is properly formatted, i.e. one dimensional.

    See the example for an example setup. Better documentation to come.

    Genesis

    I used to use node-scraper but its dependency on jsdom made it heavy and had memory-leak issues on large jobs. Cheerio is a much lighter alternative.

    install

    npm i alphabits

    Downloadsweekly downloads

    8

    version

    0.3.0

    license

    MIT

    repository

    github.com

    last publish

    collaborators

    • avatar