@mapbox/wikibush

0.0.5 • Public • Published

wikibush

Put wikidata dumps into rbush. To get around blowing up memory of a single process, this sets up shards and datafiles for seeking on disk rather than storing full feature data in memory. Goal is to allow full wikidata dump to be accessible via a single interface.

Usage example

# stream wikidata dump into wikibush storage
mkdir workdir
cat wikidata-20161107-geo.ldjson.bz2 - | bzip2 -d | wikibush-writer --workdir=workdir --tolerance=0.001

# read features around point back out
wikibush-reader --workdir=workdir --lon=-73.9975 --lat=40.7308

Readme

Keywords

none

Package Sidebar

Install

npm i @mapbox/wikibush

Weekly Downloads

0

Version

0.0.5

License

none

Last publish

Collaborators

  • mbx-npm-ci-production
  • mbx-npm-ci-staging
  • mbx-npm-advanced-actions-production
  • mbx-npm-advanced-actions-staging
  • mbx-npm-09-production
  • mbx-npm-08-production
  • mbx-npm-07-production
  • mbx-npm-06-production
  • mbx-npm-05-production
  • mbx-npm-04-production
  • mbx-npm-03-production
  • mbx-npm-02-production
  • mbx-npm-01-production
  • mbx-npm-02-staging
  • mapbox-npm-01
  • mapbox-npm-02
  • mapbox-npm-07
  • mapbox-npm-03
  • mapbox-npm-04
  • mapbox-npm-09
  • mapbox-npm-05
  • mapbox-npm-06
  • mapbox-npm-08
  • mapbox-npm-advanced-actions
  • mapbox-npm-ci
  • mapbox-npm
  • mapbox-admin
  • mapbox-machine-user