For anyone with similar issue, I managed to get crosswalk working eventually (after a day of trial and error) by following articles
- How to get Crosswalk working with Android - Step by step guide
- https://gist.github.com/andreivolt/7d40211bd5ed361e844f
It is painful because I did not have eclipse or other tools needed for this installed. I also tried to use development version of meteor from github and cordova-crosswalk plugin but hit more stability issues with that and reverted to using the above articles.