Jpizzo 0 Posted December 17, 2014 Report Share Posted December 17, 2014 Guys, It's been a while ( a few years ) since I have used UBOT. I am trying to use it to jump on backpage.com and scraping the United States only hrefs. I am "navigating" "adding list to list with scrape element and the element I'm using is class="united-states geoBlock"" I am trying to grab all the hrefs with-in that block but it grabs nothing. I can grab all the hrefs off the page but that does me no good. Any ideas on what I'm doing wrong? I am adding a screenshot to give you an idea..... Please Help me get back up to speed....... Quote Link to post Share on other sites
Jpizzo 0 Posted December 17, 2014 Author Report Share Posted December 17, 2014 Guys, It's been a while ( a few years ) since I have used UBOT. I am trying to use it to jump on backpage.com and scraping the United States only hrefs. I am "navigating" "adding list to list with scrape element and the element I'm using is class="united-states geoBlock"" I am trying to grab all the hrefs with-in that block but it grabs nothing. I can grab all the hrefs off the page but that does me no good. Any ideas on what I'm doing wrong? I am adding a screenshot to give you an idea..... Please Help me get back up to speed....... Quote Link to post Share on other sites
sunny9495 42 Posted December 17, 2014 Report Share Posted December 17, 2014 Can you please give the ubot code. Quote Link to post Share on other sites
Pete 121 Posted December 17, 2014 Report Share Posted December 17, 2014 add list to list(%urls,$list from text($find regular expression($scrape attribute(<class="united-states geoBlock">,"outerhtml"),"[-a-zA-Z0-9@:%_\\+.~#?&//=]\{2,256\}\\.[a-z]\{2,4\}\\b(\\/[-a-zA-Z0-9@:%_\\+.~#?&//=]*)?"),$new line),"Delete","Global") Unchecked but looks about right 1 Quote Link to post Share on other sites
itexspert 47 Posted December 17, 2014 Report Share Posted December 17, 2014 I am not that good with Reg Expressions so i use this with large lists,only US are selected hope it helps! load html("<outerhtml=\"<div class=\\\"inner showing\\\">And this is where a large list will be once you select it! add list to list(%Backpage,$list from text(#scrape,$new line),"Delete","Global") It looks much bigger in Ubot but its handy if you are not good with Reg Expressions! 1 Quote Link to post Share on other sites
Jpizzo 0 Posted December 18, 2014 Author Report Share Posted December 18, 2014 guys that worked.. Zap your script was what put it over the top and now I just need to take the time to learn what it is actually doing. Thanks.... If you did a youtube video on it explaining the stuff that would be awesome but if not then thank you. Itsexspert yours worked too but just a lot of text in that first deal but thank you as well. Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.