Mongoose Divide and Conquer
Allows you to divide and conquer an entire mongo collection using mongoose.
An example using pika-queue:
We can give divide a model, and it will find id ranges for the given batch size. These can be pushed onto a queue for processing.
var waitress =PikaQueue =daq =Model =queue =;daq;
We can pop batches off the queue, and give them to conquer with two methods.
The first method is used to process one document. The second method is called when all documents have been processed. All documents from the batch are processed in parallel.
var waitress =PikaQueue =daq =Model =queue =;queue;