My scraping app makes a bunch of outbound HTTP requests (GET&POST) using Meteor HTTP package. However, although everything works just fine locally, I am having timeout issues on Galaxy with ETIMEOUT errors popping out every once in a while. Does Galaxy have some restrictions on outbound HTTP requests? These are the request options I am passing.
let requestOptions = {
npmRequestOptions: {
rejectUnauthorized: false,
pool: {maxSockets: Infinity}
}
};
I’ve developed a scraper and used Galaxy, I hadn’t problem with HTTP requests.
This may help: https://github.com/nodejs/node/issues/11694