Please help me scrape from us-proxy.org

[gosu 0]

Hey people

I just joined this great community yesterday, I'm excited!

I want to take all Elite proxies from us-proxy.org.

 

I saw that you guys helped him before: http://www.ubotstudio.com/forum/index.php?/topic/11109-help-me-scrape-proxies-from-hidemyass/

So I thought you might help me out too.

 

Here is what I got:

navigate("http://us-proxy.org/", "Wait")
change dropdown($element offset(<tagname="select">, 4), "elite proxy")
change dropdown(<name="proxylisttable_length">, 80)
clear list(%usproxy)
add list to list(%usproxy, $scrape attribute(<tagname="td">, "innertext"), "Delete", "Global")
alert(%usproxy)
clear list(%prox1)
loop($subtract($list total(%usproxy), 7)) {
    if($comparison($list position(%usproxy), "<", $list total(%usproxy))) {
        then {
            add item to list(%prox1, "{$next list item(%usproxy)}:{$next list item(%usproxy)}", "Delete", "Global")
        }
        else {
        }
    }
    set list position(%usproxy, $add($list position(%usproxy), 6))
}
alert(%prox1)

Thank you!

[UBotDev 276]

The problem is that you don't wait enough time for the page to load, so your code finishes while the page is sill loading.

 

You need to start using "wait for element" command to ensure that the page has enough time to load, and you need to use that every time you are reload the page (click and navigate commands). Additionally, to make your application "robust" you should also use if($exists(XXX)) statements to confirm that the page was loaded, if it's not, you could thrown an error (alert) or something...