High level overview of running jobs to update datastore

At the end of the day, a production Meteor app is just a Nodejs app. Having said that, Meteor comes with its own websocket based protocol (DDP), which you may find useful whether or not you use Meteor for the monitoring servers. There is a package which you may find useful here. It allows a simple Nodejs app to leverage Meteor Methods and pub/sub.