wotanii

web-tree-crawl

Simple framework for crawling/scraping web sites. The result is a tree, where each node is a single request.