Mobile apps updated from Google Play /App Store still point to the old server

The new version of our mobile app uses different server from the old version.
Any new install works just fine. But any previous install (though got updated through Google/Apple Store) still point to the old server.
We suspect that the ROOT_URL got cached and persisted in the device throughout the update.

Any help here is greatly appreciated.