Nutritious Pomegranate Muffins

    consolecrawler

    0.0.5 • Public • Published

    PhantomJS Console Crawler

    This crawler will scan a website for links, follow them, then report back any javascript console errors.

    Useful for javascript heavy websites to check updates have not caused any JS errors.

    Requirements

    • Currently this only works on unix systems
    • You need to have pkill installed, try typing which pkill, if not you can try brew install pkill

    Installation

    You can easily install the package via npm npm install consolecrawler -g

    As long as your NPM modules is in your $PATH you should be able to run consolecrawler from your command line.

    Usage

    Usage: consolecrawler [options]
    
     Crawls a given website using PhantomJS - and logging any console errors
    
     Options:
    
       -h, --help          output usage information
       -V, --version       output the version number
       -u, --url <string>  Define the URL you want to crawl
       -m, --max <n>       Defines max pages to scan (defaults to 25)
       -i, --id <string>   Defines the ID of a scan, useful for debugging logs
    
       -l, --log           Writes the raw output to file
       -v, --verbose       Gives more verbose logging messages
    

    Notes

    • For each webpage crawled, a new process gets created on the machine, these should get cleaned up after shutting down, but if they don't you can run pkill -f phantomjs
    • Your computer may take off into space.

    Keywords

    none

    Install

    npm i consolecrawler

    DownloadsWeekly Downloads

    0

    Version

    0.0.5

    License

    MIT

    Last publish

    Collaborators

    • owenmelbz