rolf5th 0 Posted November 4, 2011 Report Share Posted November 4, 2011 Hi, I just want to ask if if you use multi threading in V4, Does it crash a lot. When I got to 150th and above url, it will crash... This is very frustrating since Im going to process thousands of URLS.. Please look at my script if something is wrong with it. When a list is below 100, it seldom crash.. ui open file("Sites To Test", #sitestotest) ui text box("Threads", #threads) ui stat monitor("URL Position", $list position(%sitestotest)) clear list(%sitestotest) add list to list(%sitestotest, $list from file(#sitestotest), "Delete", "Global") clear list(%goodsites) clear list(%badsites) divider loop(#threads) { thread { loop while($eval($list position(%sitestotest) < $list total(%sitestotest))) { in new browser { navigate($next list item(%sitestotest), "Wait") wait for browser event("Page Loaded", "") wait(2) wait for browser event("Page Loaded", "") click(<innertext=w"click this*">, "Left Click", "No") wait for browser event("Page Loaded", "") wait(2) wait for browser event("Page Loaded", "") click(<innertext=w"Create This*">, "Left Click", "No") wait for browser event("Page Loaded", "") wait(2) wait for browser event("Page Loaded", "") wait(5) if($search page("Search Query")) { then { add item to list(%goodsites, $url, "Delete", "Global") wait(2) } else { add item to list(%badsites, $url, "Delete", "Global") wait(2) } } } } } } Save Data() define Save Data { save to file("C:\\Folder\\GOOD SITES.TXT", %goodsites) save to file("C:\\Folder\\BAD SITES.TXT", %badsites) } by the way, it does not save the list to txt, I have to run the node of save to file manually after the bot finishes in order for it to save to text. Quote Link to post Share on other sites
Bob The Builder 62 Posted November 4, 2011 Report Share Posted November 4, 2011 Hi, I just want to ask if if you use multi threading in V4, Does it crash a lot. When I got to 150th and above url, it will crash... This is very frustrating since Im going to process thousands of URLS.. Please look at my script if something is wrong with it. When a list is below 100, it seldom crash.. ui open file("Sites To Test", #sitestotest) ui text box("Threads", #threads) ui stat monitor("URL Position", $list position(%sitestotest)) clear list(%sitestotest) add list to list(%sitestotest, $list from file(#sitestotest), "Delete", "Global") clear list(%goodsites) clear list(%badsites) divider loop(#threads) { thread { loop while($eval($list position(%sitestotest) < $list total(%sitestotest))) { in new browser { navigate($next list item(%sitestotest), "Wait") wait for browser event("Page Loaded", "") wait(2) wait for browser event("Page Loaded", "") click(<innertext=w"click this*">, "Left Click", "No") wait for browser event("Page Loaded", "") wait(2) wait for browser event("Page Loaded", "") click(<innertext=w"Create This*">, "Left Click", "No") wait for browser event("Page Loaded", "") wait(2) wait for browser event("Page Loaded", "") wait(5) if($search page("Search Query")) { then { add item to list(%goodsites, $url, "Delete", "Global") wait(2) } else { add item to list(%badsites, $url, "Delete", "Global") wait(2) } } } } } } Save Data() define Save Data { save to file("C:\\Folder\\GOOD SITES.TXT", %goodsites) save to file("C:\\Folder\\BAD SITES.TXT", %badsites) } by the way, it does not save the list to txt, I have to run the node of save to file manually after the bot finishes in order for it to save to text.there are some issues with threads, Eddie has some fixes but waiting to test myself. Quote Link to post Share on other sites
JohnB 255 Posted November 5, 2011 Report Share Posted November 5, 2011 You're going to have major issues if you don't throttle the number of threads. Remember, these are not sockets these are actual browsers. You should really limit the number of threads. John Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.