Thief CLI =========
An extremely fast web scraper that parses megabytes of HTML in a blink of an eye. No dependencies. PHP5+
Web crawler wrapper around puppeteer module to simply the crawling on ajax/java script enabled pages.
Harvesting data at the <html> mine.
Data extraction tools.
Parkour the web like a yamakazi
A simple web crawler
Stores a unique list of domain names and their page rank at time of crawling
Simple selenium web crawler
Environment for Goose Parser which allows to run it using JsDOM
Utils for authorize your IP in your rev.proxies.online account
A Wight backend for fetching static web pages
easily create crawlers based on self-replicated scrapers
A tool for getting public website content using a browser engine or http get.
Simple website crawler and scraper
Scalable, extensible, web crawler framework.