Ailton
-
Content Count
3 -
Joined
-
Last visited
Posts posted by Ailton
-
-
Oh, ok! Basically scraping e-commerce sites. But you right. It's impossible running all at same time downloading stuff with a limited bandwidth.
-
Hi! Newbie here! Sorry, but my english it's not so good... I was reading several topics about "running multiple bots", "memory leak", etc, but i could'nt find something about the max number of bots running. My question is, can i run a large number of bots, scraping different sites? By "large" i mean, more then 100 at same time?
MEMORY LEAK ISSUE: Temporary solution which has helped prevent bot crashes
in Scripting
Posted
Yes, a have 2 dedicateds at Liquidweb and Hostgator... With your experience, could you tell me how long takes to scrape basic informations like prices, description, url, etc, (without the images) from a big website commerce like this one: www.submarino.com.br?