Cron job server(ec2) memory keeps increasing until it shuts down

[saurabh-at-shvasa]

Hi,

I have a node js server running on ec2 instance with 4gb ram. In that we are using bree to run cron jobs. After restarting the server the memory goes to zero then keeps increasing as the cron jobs runs and then once it reaches max memory server f.

Here is the main index.js file that runs

I have tried updating to bree's latest version also i.e. 9.0.1

[shadowgate15]

I don't think this is an issue with Bree but we are looking into some of our setups to see if we see a similar result. You might try running 1 job at a time to see if it is a particular job that is causing the memory creep.

[saurabh-at-shvasa]

Thanks! Yea we can try to check if any particular cron job is causing this issue but running one at a time will take some time i guess. I'll check that for sure and revert meanwhile please look if you find this issue with any other setup.

[shaunwarman]

// signal to parent that the job is done
if (parentPort) parentPort.postMessage('done');
else process.exit(0);

Are your jobs / processes properly shutting down? If you run ps aux for example do you see a lot of bree processes running?

[saurabh-at-shvasa]

I'll check this and will share the output thanks.

[saurabh-at-shvasa]

Hi @shadowgate15 @shaunwarman as you can see there are total of 12 threads running for my node process and it stays 12 so i am assuming processes are not exiting? But even on running one job it says 12 so not sure are these threads related to cron jobs

[titanism]

This is not an issue with Bree, it is an issue with how you architect your jobs.