Pump data from a mysql databse to aws dynamo db.
This is just an internal project to be able to pump data from a mysql database into AWS DynamoDB. It's able to pumpe large ammounts of data as fast as your connection and dynamo write throughput allows.
It will not loose data if AWS returns your data by exceed the write throughput. It tries to throttle and accelerate the pumping speed to find the maximum allowed write throughput.
All you have to do is overwrite the methods
convertToDynamoItem() and create the
config.json file like the
For an example have a look at the file
To build it you have to run
npm install cli mysql-dynamo-pump.
You can read the console help by starting it with
node example.js --help