I am looking to build an aggregator that pulls in multiple 3rd party APIs on a periodic basis, once per day let’s say, that will store the information in a collection. Then I can just use the publish/subscribe method to show that in my react components on the client side. I would prefer to do it this way, rather than loading a bunch of data from different end points to display at the point of request, it would be faster if it was all on the local mongo db I am using.
So to be clear: What is the pattern to set up custom methods (ideally for each 3rd party API), that will go grab their data, once per day, then store it in the collection. I would need to customize each API call because they have different formats and I want to normalize them. I am interested in this problem alone, but if there is something related to subscribe/publish concepts in React with your approach, be sure to include it.
Thanks in advance!