UBotDev 276 Posted May 14, 2011 Report Share Posted May 14, 2011 Hey Folks, Just now I am trying to scrape all of the shown ads for one keyword (on Google Search), and I got stuck. After few test ccrapes, I am still not able to scrape each ad title, description and link separately, to build a table. Has anyone already done that? Thanks for info. Greetings, theAnimalix Quote Link to post Share on other sites
UBotBuddy 331 Posted May 15, 2011 Report Share Posted May 15, 2011 There are ways. But before we can answer we need you to update your Profile to answer some questions. Look at my profile on the Left of this post. You only have to do that once. Quote Link to post Share on other sites
UBotDev 276 Posted May 15, 2011 Author Report Share Posted May 15, 2011 Hm...do you mean "System Specs"? A already filled that in, but I'm not sure why they aren't showed on forum. :/ Quote Link to post Share on other sites
Guerrilla 19 Posted May 16, 2011 Report Share Posted May 16, 2011 I wrote an adwords scraper. The annoying thing was that google change the html from search to search. There are 3 main types of pattern (well there were when i did it). Also to scrape multiple pages you will need to disable cookies otherwise when you programatically access several pages google just starts showing you the same set of ads over and over again. Quote Link to post Share on other sites
UBotDev 276 Posted May 16, 2011 Author Report Share Posted May 16, 2011 Thanks for your tips Guerilla! I noticed that it is hard to scrape because of different html and random strings surrounding attributes I want to scrape. :/ Quote Link to post Share on other sites
UBotBuddy 331 Posted May 16, 2011 Report Share Posted May 16, 2011 Which ones are you scraping? The one on the right side of the page or the one right above the search results or even the one embedded with the search results? Quote Link to post Share on other sites
UBotDev 276 Posted May 17, 2011 Author Report Share Posted May 17, 2011 Which ones are you scraping? The one on the right side of the page or the one right above the search results or even the one embedded with the search results? I want to scrape all ads that appear on certain keyword. Thanks for helping. Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.