node package manager
Loosely couple your services. Use Orgs to version and reuse your code. Create a free org ยป

spidercheck

SpiderCheck

basic web crawler

var spider = new SpiderCheck()

Events

  • 'error' - (error)
  • 'crawl' - (statusCode, url, res)

spider.addURL(url)

add a URL to the crawl queue

spider._crawl()

start crawling