Help me scrape proxies from HIDEMYASS

[General Lee 12]

This is driving me crazy, but I understand it's all part of the learning process. The code below is where I'm at now. I can't figure out how to use a wild card to collect all the proxies targeted. Thanks to anyone who helps!

 

navigate("http://www.hidemyass.com/proxy-list/", "Wait")
wait for browser event("Everything Loaded", "")
change checkbox(<name="ac">, "Unchecked")
change dropdown(<country dropdown>, "United States (26)")
change checkbox($element offset(<name="sp[]">, 0), "Unchecked")
change checkbox($element offset(<name="ct[]">, 0), "Unchecked")
click(<id="updateresults">, "Left Click", "No")
add list to list($scrape attribute($element offset(<outerhtml=w"<span id=\"*\" style=\"float:left;height:0;width:0\"></span>">, 2), "innertext"), %prox, "Delete", "Global")

[k1lv9h 76]

Hi,

 

This should work. I added code to include the Port number for each IP Address.

 

Sample code:

navigate("http://www.hidemyass.com/proxy-list/", "Wait")
wait for browser event("Everything Loaded", "")
change checkbox(<name="ac">, "Unchecked")
change dropdown(<country dropdown>, "United States")
change checkbox($element offset(<name="sp[]">, 0), "Unchecked")
change checkbox($element offset(<name="ct[]">, 0), "Unchecked")
click(<id="updateresults">, "Left Click", "No")
wait for browser event("Everything Loaded", 30)
clear list(%paddress)
clear list(%pport)
clear list(%prox)
add list to list(%paddress, $scrape attribute(<outerhtml=w"<span><style>*</span>">, "innertext"), "Don\'t Delete", "Global")
add list to list(%pport, $scrape attribute(<outerhtml=w"<td>
*</td>">, "innertext"), "Don\'t Delete", "Global")
loop($list total(%paddress)) {
   if($comparison($list position(%paddress), "<", $list total(%paddress))) {
       then {
           add item to list(%prox, "{$next list item(%paddress)}:{$next list item(%pport)}", "Delete", "Global")
       }
       else {
       }
   }
}

 

Kevin

[General Lee 12]

Thanks big Ken! I'll give her a kick

[General Lee 12]

Bummer... no dice. Viewing the debugger show nothing scraped?

[k1lv9h 76]

Hi,

 

Add this after line click(<id="updateresults">, "Left Click", "No")

wait for browser event("Everything Loaded", 30)

 

Kevin

[General Lee 12]

Thank again man, I think you nailed it! Somebody give this guy a raise..

[webpro 31]

I will try this as i'm ready to add proxy features on my first bots

 

Thanks

[dahid84 5]

i try to use this bot but dosen't work ;/ Someone can fixed it ? please

[HelloInsomnia 1103]

i try to use this bot but dosen't work ;/ Someone can fixed it ? please

 

I edited it to work in a similar way it did before. It doesn't look like there is any great way to get that port so I scraped the table to get it but there is probably a better way to do it if you want to put the time into finding it

navigate("http://www.hidemyass.com/proxy-list/", "Wait")
wait for browser event("Everything Loaded", "")
change checkbox(<name="ac">, "Unchecked")
change checkbox($element offset(<name="sp[]">, 0), "Unchecked")
change checkbox(<(name="a[]" AND value=0)>, "Unchecked")
change checkbox(<name="pl">, "Unchecked")
change checkbox(<(name="ct[]" AND value=1)>, "Unchecked")
change dropdown(<name="pp">, "100 per page")
change attribute(<name="c[]">, "value", "United States")
wait(1)
click(<id="proxy-list-upd-btn">, "Left Click", "No")
wait for browser event("Everything Loaded", 30)
clear list(%paddress)
clear list(%prox)
add list to list(%paddress, $scrape attribute(<outerhtml=w"<span><style>*</span>">, "innertext"), "Don\'t Delete", "Global")
clear table(&table)
scrape table(<id="listable">, &table)
set(#test, $scrape attribute($element child(<tagname="tr">), "innerhtml"), "Global")
set(#row, 0, "Global")
loop($list total(%paddress)) {
    add item to list(%prox, "{$next list item(%paddress)}:{$table cell(&table, #row, 2)}", "Delete", "Global")
    increment(#row)
}

[dahid84 5]

thx ;]

 

 

any ideas where i can find free list of proxies ?

Edited May 12, 2015 by dahid84

[HelloInsomnia 1103]

thx ;]

 

 

any ideas where i can find free list of proxies ?

 

Sure thing:

 

http://www.proxyfire.net/forum/forumdisplay.php?f=14

http://www.blackhatworld.com/blackhat-seo/f103-proxy-lists/

Find your own pretty easily by doing this as well:

 

site:blogspot.com ":80" +":8080"

 

^^ in Google then change the time to be last 24 hours or even last week if you're just looking for new sites. Generally the homepage or blog feed of those Blogspot sites will be easily scrapeable.

[dahid84 5]

God bless you ;]