kue-sweeper

a simple nodejs service to avoid memory leaking when use kue to process millions of jobs by removing kue job immediately upon its completion

kue-sweeper

a simple nodejs service to avoid memory leaking when use kue to process millions of jobs by removing kue job immediately upon its completion

kue is a handy redis-backed job processing module. But when using kue for processing millions of jobs, we have met following circumstances incuring memory leaking.

So I wrote this little tool to run as a standalone service (via forever) which will keep watching kue and remove kue job immediately upon its completion

Install forever tool

npm install forever -g

Install the kue-sweeper

npm install kue-sweeper
# start kue-sweeper with forever
./forever-start-kue-sweep.sh
  • -p --port , redis service port
  • -h, --host [VALUE], redis service host

Copyright (c) 2013 yi Licensed under the MIT license.