Jump to content



Photo

Please help me scrape from us-proxy.org

proxy scrape

  • Please log in to reply
1 reply to this topic

#1 gosu

gosu

    Newbie

  • Fellow UBotter
  • Pip
  • 1 posts
  • OS:Windows 8
  • Total Memory:2Gb
  • Framework:v4.0
  • License:Professional Edition

Posted 11 September 2014 - 12:58 AM

Hey people

I just joined this great community yesterday, I'm excited!

I want to take all Elite proxies from us-proxy.org.

 

I saw that you guys helped him before: http://www.ubotstudi...from-hidemyass/

So I thought you might help me out too.

 

Here is what I got:

navigate("http://us-proxy.org/", "Wait")
change dropdown($element offset(<tagname="select">, 4), "elite proxy")
change dropdown(<name="proxylisttable_length">, 80)
clear list(%usproxy)
add list to list(%usproxy, $scrape attribute(<tagname="td">, "innertext"), "Delete", "Global")
alert(%usproxy)
clear list(%prox1)
loop($subtract($list total(%usproxy), 7)) {
    if($comparison($list position(%usproxy), "<", $list total(%usproxy))) {
        then {
            add item to list(%prox1, "{$next list item(%usproxy)}:{$next list item(%usproxy)}", "Delete", "Global")
        }
        else {
        }
    }
    set list position(%usproxy, $add($list position(%usproxy), 6))
}
alert(%prox1)

Thank you!



#2 UBotDev

UBotDev

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 1395 posts
  • OS:Windows 10
  • Total Memory:More Than 9Gb
  • Framework:v3.5 & v4.0
  • License:Developer Edition

Posted 11 September 2014 - 02:42 AM

The problem is that you don't wait enough time for the page to load, so your code finishes while the page is sill loading.

 

You need to start using "wait for element" command to ensure that the page has enough time to load, and you need to use that every time you are reload the page (click and navigate commands). Additionally, to make your application "robust" you should also use if($exists(XXX)) statements to confirm that the page was loaded, if it's not, you could thrown an error (alert) or something...


CLICK UBotDev.com - Download FREE UBot Plugins!

______________________________________________

 






0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users