Simple configuration mechanism allowing infrastructure engineeers to override values via environment variables
published 0.0.15 9 years agoVery straigntforward web crawler. Uses EventEmitter. Generates queue statistics and has a basic cache mechanism with extensible backend. This version is forked in order to add the ability to filter by referrer url
published 0.3.1-1.2 8 years ago