Krawala
Simple javascript web-crawler with command line interface
Install
Run the following to install as a global CLI
npm i krawala -g
Usage
Usage: krawala crawl [options] Options: --help, -h Display help and usage info --depth, -d Depth to crawl [number] --format, -f Format to return [string] --interval, -i Interval between requests [number] --timeout, -t Maximum time to wait