allcapone1912 7 Posted January 2, 2016 Report Share Posted January 2, 2016 hi,currently have a problem scraping flash sitesmy code scrape all url from website navigate("http://sutroarchitects.com/","Wait") wait(5) add list to list(%all url,$scrape attribute(<href=r"">,"fullhref"),"Delete","Global") and its not working for site like http://sutroarchitects.com/so, how to scrape it? if i check website page souce its show a lot of url Quote Link to post Share on other sites
bestmacros 60 Posted January 2, 2016 Report Share Posted January 2, 2016 use regular expression or xpath to scrape data from the website page source which you can get by using "document text" function. Quote Link to post Share on other sites
pash 504 Posted January 3, 2016 Report Share Posted January 3, 2016 try. navigate("http://sutroarchitects.com/","Wait") wait for browser event("Everything Loaded","") wait(1) set(#Html,$document text,"Global") set(#Report,$find regular expression(#Html,"href=\"/PROJECTS/.*?\""),"Global") set(#Report,$replace(#Report,"href=\"","http://sutroarchitects.com"),"Global") set(#Report,$replace(#Report,"\"",""),"Global") add list to list(%Report,$list from text(#Report,$new line),"Delete","Global") alert(%Report) 1 Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.