scrapingnode
scrapingnode
A simple command-line wrapper around ineed.
Installation
npm i -g scrapingnode
Usage:
scrapingnode
Usage: scrapingnode <option> <url>Option can be one of:content (which collects content) ordata (which collects links, scripts, etc.) orcode (which collects HTML comments, CSS, and JS)all (all of the above) Example: scrapingnode code zacanger.comYou can leave off the https:///http:// if you want. Or not. Up to you.
You'll get a bunch of stuff you can really easily parse. Nice, huh?
Maybe do something like scrapingnode content blog.zacanger.com > zacs-blog.json,
or scrapingnode code zacanger.com/p | jq .jsCode or something.
Contributions welcome.
License: WTFPL.
Private packages for the whole team
It’s never been easier to manage developer teams with varying permissions and multiple projects. Learn more about Private Packages and Organizations…
-
zacanger published 2016-08-28T19:51:08.896Z
- 0.3.9 is the latest of 12 releases
- github.com/zacanger/scrapingnode
- WTFPL
Collaborators list
Stats
- 0 downloads in the last day
- 0 downloads in the last week
- 39 downloads in the last month
- Have an issue? File it.
Try it out
Keywords
cli, command-line, ineed, scraper, scraping, web-scraper