Jump to content
UBot Underground

[Solved]Scraping URLs


Recommended Posts

I'm trying to scrape all the urls containing the text "studyguide" but am having no luck. Anyone see the problem?

 

navigate("http://www.bookrags.com/browse/studyguides/", "Wait")

click(<class="arialr">, "Left Click", "No")

clear table(&urls)

loop while($scrape attribute(<innertext="Next 50 ››">, "innertext")) {

scrape table(<href=w"*studyguide*">, &urls)

}

 

Thanks!

http://ubotstudio.com/forum/public/style_emoticons/default/smile.gif

Link to post
Share on other sites

Try this:

 

navigate("http://www.bookrags.com/browse/studyguides/", "Wait")

click(<class="arialr">, "Left Click", "No")

loop while($exists(<innertext="Next 50 ››">)) {

add list to list(%urls, $scrape attribute(<href=w"/studyguide*/">, "fullhref"), "Delete", "Global")

click(<innertext="Next 50 ››">, "Left Click", "No")

wait(4)

}

 

 

John

Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
×
×
  • Create New...