MaximusAurelius 0 Posted December 26, 2015 Report Share Posted December 26, 2015 Just finished plowing through Tutorial 5 on the Ubot site, but unfortunately that video is horribly outdated and the source code of Google has changed significantly. There is no <class = "l"/> tag anymore, only the <class = "r"/> tag which gives you a bunch of www.google.com/ssl= results for your list items.If all that above means nothing to you, I guess my question is what is a updated and efficient way of scraping Google results, using either the $scrape attribute or $page scrape parameters? Quote Link to post Share on other sites
pftg4 102 Posted December 26, 2015 Report Share Posted December 26, 2015 ui log view("Log") set(#log,$nothing,"Global") section("scrape google url\'s") { purpose("scraping google url\'s from search term") define scrape google search terms(#Search term) { log("loading google") navigate("https://www.google.com/?gws_rd=ssl","Wait") wait for element(<id="logocont">,"","Appear") log("page loaded") type text(<name="q">,#Search term,"Standard") wait for element(<id="sblsbb">,"","Appear") log("search term loaded") click(<login button>,"Left Click","No") log("search button pressed") wait for browser event("Everything Loaded","") clear list(%urls) add list to list(%urls,$scrape attribute(<class="_Rm">,"innertext"),"Delete","Global") log("search completed {$list total(%urls)} scraped") alert("Search Term:= {#Search term} {$list total(%urls)} urls\'s scraped {%urls}") } } scrape google search terms("hoverboard") 1 Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.