consolecrawler

PhantomJS Console Crawler

This crawler will scan a website for links, follow them, then report back any javascript console errors.

Useful for javascript heavy websites to check updates have not caused any JS errors.

Requirements

• Currently this only works on unix systems
• You need to have pkill installed, try typing which pkill, if not you can try brew install pkill

Installation

You can easily install the package via npm npm install consolecrawler -g

As long as your NPM modules is in your $PATH you should be able to run consolecrawler from your command line.

Usage

Usage: consolecrawler [options]

 Crawls a given website using PhantomJS - and logging any console errors

 Options:

   -h, --help          output usage information
   -V, --version       output the version number
   -u, --url <string>  Define the URL you want to crawl
   -m, --max <n>       Defines max pages to scan (defaults to 25)
   -i, --id <string>   Defines the ID of a scan, useful for debugging logs

   -l, --log           Writes the raw output to file
   -v, --verbose       Gives more verbose logging messages

Notes

• For each webpage crawled, a new process gets created on the machine, these should get cleaned up after shutting down, but if they don't you can run pkill -f phantomjs
• Your computer may take off into space.