We have real time chat application, where admin can see all chats going on. We need to publish following data
- latest message
- conversation user
- conversation assignee
We use publish composite to publish related data. When the published list of conversations are upto 100, it works well. When user selects page size as 200 it becomes slow, and extremely slow on page size of 400-500, that every request takes more than a min to complete.
we use 10+ servers in production behind load balancer, data is properly indexed. Only server where such query with bigger page size goes, it becomes slow/dead.
Upon checking in kadira monitoring, it shows whenever such happens, livedata shows number of oplog notifications has gone up from 20-30k/minute to 100-150k/minute. I am unable to relate, how changing page size would affect number of oplog notifs, even though not much changes are happening on the data being published.