crawlr

0.1.0 • Public • Published

crawllr

Use: node crawl.js http://domain.com

Don't use trailing slash. No Good. Will only capture URL's for the domain above... no similarity subdomains (like www vs non www for hardcoded links).

###Docker Usage

To use with docker:

docker build -t crawlr .

docker run -it crawlr [domain]

Readme

Keywords

none

Package Sidebar

Install

npm i crawlr

Weekly Downloads

1

Version

0.1.0

License

MIT

Last publish

Collaborators

  • jga