kev123 132 Posted February 27, 2015 Report Share Posted February 27, 2015 Hi all I've got a lot of bot updates to do over the next week or so for customers and quite a few have challenges which is going to occupy my time. What i'm after is code for scraping the new google maps this needs to be by using the http plugin and not browser. old google maps is https://maps.google.com and new is https://google.com/maps I don't need any other code apart from the scraping preferably in a define. steps required are: navigate to sitesearch using keywordloop through all available results scraping data detecting when there's no more pages, 10 results are displayed at a time. generally there's 10-30 pages. Fields required:company namecompany addresstelephone numberwebsiteif place claimedsecondary categoriesgoogle map page for businesslatitude and longitude for business this needs added to a table preferably using the large data plugin but not a issue if you use ubot normal table as i'll convert it. This is probably for the more experienced http plugin guys as most of the above requires replicating java calls with the http plugin and there's also a lot of other stuff going on that I've not had time to check. I recommend checking with fiddler before quoting.Just to be clear the browser cant be used at all.. many thankskev123 Quote Link to post Share on other sites
musician87 2 Posted March 16, 2015 Report Share Posted March 16, 2015 I'm looking for this kind of bot too, have you find something? Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.