Hi everyone.
I’ve deployed my meteor app from meteor galaxy correctly http://perfilesgs.meteorapp.com/. Everything works fine except for a problem. In my app I query a Google URL via routes, for the purpose of scraping and get data.
The problem is that in my app on my localhost (localhost:3000) it works fine, since query done has the response headers from the server.
But once deployed to meteor galaxy, the log records shows that google does not allow automatic queries.
The strange thing is that in my localhost I can make the query perfectly and get the data, but in my web server I get the following message:
We’re sorry … … but your computer or network may be sending automated queries. To protect our users, we can not process your request right now
I would appreciate any advice or help to solve this problem. Thank you very much, Greetings.
Router.route('/scraper/:id_investigador', function(){
this.response.setHeader( 'Access-Control-Allow-Origin', '*' );
this.response.setHeader( 'Access-Control-Allow-Methods', 'GET, POST, PUT, DELETE' );
this.response.setHeader( 'Access-Control-Allow-Headers', 'Content-Type, X-Requested-With, x-request-metadata' );
this.response.setHeader( "Content-Type", "text/html; charset=utf-8" );
this.response.setHeader( 'Access-Control-Allow-Credentials', true );
var url = 'https://scholar.google.cl/citations?user=' + id_investigador
request(url, async function(error, response, html){
var $ = cheerio.load(html);
.
.
.
}
}, {where : "server"});