Search results

dcrawler

DCrawler is a distribited web spider written in Nodejs and queued with Mongodb. It gives you the full power of jQuery to parse big pages as they are downloaded, asynchronously. Simplifying distributed crawler!

• distribited
• crawling
• spider
• scraper
• scraping
• jquery
• crawler

blikenoother

published 0.0.8 • 9 years agopublished 0.0.8 9 years ago