Website Scraper for Wikipedia
Collect following data sources from Wikipedia:
Module provide following sections for each data source:
scraper: Scraper is responsible to parse source page from Wikipedia and provide result in callback.
exporter: Exporter will use scraper to collect data and expose different export types such as JSON or CSV.
Install using npm:
$ npm install webscraper-wikipedia
Please refer to
scraper samples and
Generated data are located in
./data/ folder. To refresh data use generators located in
./generators/ folder. For instance to refresh data for timezone database use following command:
$ cd ./generators/ ; node timezone.js
Enhance following sources:
Add new sources: