wholenewsorg

tfrecord-stream

Reader and writer for the TensorFlow Record file format

tree-stream

pipe and split streams, closing all of them if one of them closes

@wholebuzz/fs

File system interface abstraction with implementations for GCP GCS, AWS S3, Azure, SMB, and Local file systems.

@wholebuzz/secrets

Secrets interface abstraction with implementations for GCP, and AWS

@wholebuzz/archive-base

Shared code for archive database

@wholebuzz/archive

Archive database using sorted chains of JSON array blocks

@wholebuzz/archive-client

Archive database client

@wholebuzz/search

Persistent inverted index and BM25 search engine with proximity penalty.

@wholebuzz/binary-merge

2-way merge

@wholebuzz/query

Parse text query language to object filter

@wholebuzz/cluster

SimHash text clustering with OutRank outlier removal and Variation of Information analysis.

db-watch

Database replication, inlcuding Postgres triggers and monitoring with notify listeners

dbcp

Dump Mysql, Postgres, SQLServer, and ElasticSearch databases directly to AWS S3, Google Cloud Storage, or Azure.

db-json-column

JSON column support for Knex and TypeORM

@wholebuzz/mapreduce

Communication-free MapReduce for the 99%