node package manager
Orgs are free. Discover, share, and reuse code in your team. Create a free org »

scrapingnode

scrapingnode

A simple command-line wrapper around ineed.

Installation

npm i -g scrapingnode

Usage:

scrapingnode

Usage: scrapingnode <option> <url>
Option can be one of:
content   (which collects content) or
data      (which collects links, scripts, etc.) or
code      (which collects HTML comments, CSS, and JS)
all       (all of the above)
 
Example: scrapingnode code zacanger.com

You can leave off the https:///http:// if you want. Or not. Up to you.

You'll get a bunch of stuff you can really easily parse. Nice, huh?

Maybe do something like scrapingnode content blog.zacanger.com > zacs-blog.json, or scrapingnode code zacanger.com/p | jq .jsCode or something.

Contributions welcome.

License: WTFPL.