Best practice for long running server side jobs on Meteor


#1

What is the best practice for long running server side jobs on Meteor.

For example:
I have a collection “images” with fields _id, url
There are about 30,000 records in “images”.

Once a month I need to traverse through the collection and test if the URL http response is 200 or not .
What is the best way to rateLimit the url tester, and to allow for pausing, restarting, stopping.


#2

I initially thought that the job-collection package was overkill to my needs. After a month of creating my app, I already have 7 jobs created with an admin panel to manage (pause, restart, stop, cancel) these jobs