Jump to content
UBot Underground

Google Results Scrape Issue (Tutorial 5)


Recommended Posts

Just finished plowing through Tutorial 5 on the Ubot site, but unfortunately that video is horribly outdated and the source code of Google has changed significantly. There is no <class = "l"/> tag anymore, only the <class = "r"/> tag which gives you a bunch of www.google.com/ssl= results for your list items.

If all that above means nothing to you, I guess my question is what is a updated and efficient way of scraping Google results, using either the $scrape attribute or $page scrape parameters?

 

post-27345-0-30149800-1451141946_thumb.jpg

Link to post
Share on other sites

ui log view("Log")
set(#log,$nothing,"Global")
section("scrape google url\'s") {
purpose("scraping google url\'s from search term")
define scrape google search terms(#Search term) {
log("loading google")
navigate("https://www.google.com/?gws_rd=ssl","Wait")
wait for element(<id="logocont">,"","Appear")
log("page loaded")
type text(<name="q">,#Search term,"Standard")
wait for element(<id="sblsbb">,"","Appear")
log("search term loaded")
click(<login button>,"Left Click","No")
log("search button pressed")
wait for browser event("Everything Loaded","")
clear list(%urls)
add list to list(%urls,$scrape attribute(<class="_Rm">,"innertext"),"Delete","Global")
log("search completed {$list total(%urls)} scraped")
alert("Search Term:= {#Search term}

{$list total(%urls)} urls\'s scraped

{%urls}")
}
}
scrape google search terms("hoverboard")
  • Like 1
Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
×
×
  • Create New...