Jump to content
UBot Underground

Recommended Posts

hi,

currently have a problem scraping flash sites

my code scrape all url from website

navigate("http://sutroarchitects.com/","Wait")
wait(5)
add list to list(%all url,$scrape attribute(<href=r"">,"fullhref"),"Delete","Global")

and its not working for site like http://sutroarchitects.com/

so, how to scrape it?

 

 

if i check website page souce its show a lot of url

 

post-20283-0-92936100-1451760603_thumb.png

Link to post
Share on other sites

try.

navigate("http://sutroarchitects.com/","Wait")
wait for browser event("Everything Loaded","")
wait(1)
set(#Html,$document text,"Global")
set(#Report,$find regular expression(#Html,"href=\"/PROJECTS/.*?\""),"Global")
set(#Report,$replace(#Report,"href=\"","http://sutroarchitects.com"),"Global")
set(#Report,$replace(#Report,"\"",""),"Global")
add list to list(%Report,$list from text(#Report,$new line),"Delete","Global")
alert(%Report)
  • Like 1
Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
×
×
  • Create New...