chris weber 0 Posted August 18, 2010 Report Share Posted August 18, 2010 Hey everyone, I am working on a bot right now and as part of it I need to be able to go to google maps, enter a search term like "los angeles dentists" and then I need to scrape the data from say the first 5 pages or so. I really only need to scrape the data like business name, address, and phone number but if I have to scrape it all that would be ok too. My question though is how to do this. If I try to scrape like normally where I select say a row to scrape and right click it I don't get the <TR> option to scrape like I would if I was just scraping on google.com. So if anyone knows how to scrape from maps.google.com that would be amazingly appreciated. Thanks again, Chris Quote Link to post Share on other sites
MiriamMB 63 Posted August 18, 2010 Report Share Posted August 18, 2010 Hey everyone, I am working on a bot right now and as part of it I need to be able to go to google maps, enter a search term like "los angeles dentists" and then I need to scrape the data from say the first 5 pages or so. I really only need to scrape the data like business name, address, and phone number but if I have to scrape it all that would be ok too. My question though is how to do this. If I try to scrape like normally where I select say a row to scrape and right click it I don't get the option to scrape like I would if I was just scraping on google.com. So if anyone knows how to scrape from maps.google.com that would be amazingly appreciated. Thanks again, Chris Heya! I have attached an example. You would basically have to scrape the links to the pages (in case you need to replicate these on your own, choose by the first Div tag that shows up under span, and make sure you're choosing over the Business name in bold, towards the end ) where the information of the businesses are and then navigate to the pages, one by one, and scrape them all to a list, and then save the list to a file. make sure you select "Yes" on Delete Duplicates so your list of urls don't end up like mine with doubles lol Insert the right files in the right places (except the url list has already been scraped) and you can run it and check it out.Maybe you can make adapt to what you are trying to do. Google Maps Scraping.zip Quote Link to post Share on other sites
chris weber 0 Posted August 18, 2010 Author Report Share Posted August 18, 2010 Heya! I have attached an example. You would basically have to scrape the links to the pages (in case you need to replicate these on your own, choose by the first Div tag that shows up under span, and make sure you're choosing over the Business name in bold, towards the end ) where the information of the businesses are and then navigate to the pages, one by one, and scrape them all to a list, and then save the list to a file. make sure you select "Yes" on Delete Duplicates so your list of urls don't end up like mine with doubles lol Insert the right files in the right places (except the url list has already been scraped) and you can run it and check it out.Maybe you can make adapt to what you are trying to do. Google Maps Scraping.zip AWESOME. That is just what I was looking for. Thank you, Thank you, Thank you:) Quote Link to post Share on other sites
experimentit 0 Posted January 9, 2013 Report Share Posted January 9, 2013 Where is this file, it doesn t seem to be still online can you repost it or send it by mail? Quote Link to post Share on other sites
Twitter Dominator 125 Posted January 9, 2013 Report Share Posted January 9, 2013 unfortunately this thread is over 2 years old and files not current anyway so wouldn't work in today's Google maps without modification Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.