Simple Script - Constant Crashing, Errors, And Failure

[awesome sauce 0]

I've been following the below tutorial to make what I would consider a very basic bot:

 

 

However, I can't get the bot to complete without crashing or throwing errors. Here's one error I've got:

 

Error converting value True to type 'System.Collection.Generic.List'1[system.String]'.Path", line, position 4

 

The script is only trying to grab 36 items. Here's my version of the script:

 

ui stat monitor("Movie Titles:",$list total(%movie titles))

ui stat monitor("Thumbnails:",$list total(%thumbnailurls))

ui stat monitor("Full Size:",$list total(%largeimageurl))

define Scrape Data {

    clear table(&movieposters)

    clear list(%movie titles)

    clear list(%thumbnailurls)

    clear list(%largeimageurl)

    clear list(%movieposterurls)

    navigate("http://www.allposters.com/-st/Movie-Posters_c101_.htm","Wait")

    wait for browser event("Page Loaded","")

    add list to list(%thumbnailurls,$scrape attribute(<class="thmbd galImage">,"src"),"Delete","Global")

    add list to table as column(&movieposters,0,1,%thumbnailurls)

    add list to list(%movieposterurls,$scrape attribute(<class="nuln shortenedTitle">,"fullhref"),"Delete","Global")

    loop($list total(%movieposterurls)) {

        navigate($next list item(%movieposterurls),"Wait")

        wait for browser event("Everything Loaded","")

        add item to list(%movie titles,$scrape attribute(<tagname="h1">,"innertext"),"Don\'t Delete","Global")

        add list to table as column(&movieposters,0,0,%movie titles)

        add item to list(%largeimageurl,$scrape attribute(<class="mainImage shadow">,"src"),"Don\'t Delete","Global")

    }

    add list to table as column(&movieposters,0,2,%largeimageurl)

    save to file("{$special folder("Desktop")}/movieposters.csv",&movieposters)

}

Scrape Data()

 

  

Each time I run the script it crashes, which then causes UBot Studio to be extremely slow. I can't use the program after attempting to run the script without pulling my hair out, so I have to spend 10 min trying to get the program to close so I can re open it. Sometimes I even have to restart the server to get UBot back to a state that is usable. 

 

I'm running UBot on AWS with 1 CPU and 1GB RAM. 

 

What can I do to A) Have this script run to completion Stop UBot from being so slow all the time. 

[awesome sauce 0]

Maybe it's just the server I'm running it on. Does anyone else here run UBot on AWS? If so, how's your performance?

 

I just rebooted my server again and started the script. On about the 9th object to scrape UBot froze. I had the performance monitor up and it appears that my processor is getting maxed out. 

 

This page is indicating that I may not even have enough RAM to run UBot. However, looking around the net, it appears other people are running UBot with less than the suggested 2GB RAM. I'm not sure what version they are running though. Is anyone running version 5 with ~1GB RAM?

 

Should I upgrade my server?

[jason 101]

Hey Nicholas,

 

Really sorry there is an issue here. Thank you so much for posting the script. This makes it very easy to find the problem.

 

Re-producing this script on my AWS, i do see some slowdown also (in the first 36 scrapes). It looks like there might be some issues with the size of the bot. If you wouldn't mind, let's continue the bug fixing over at the tracker (tracker.ubotstudio.com).

 

I'm opening a tracker issue for you and sending you more information via private message.

 

We'll work on this asap!

[webpro 31]

Hi Jason

I'm getting crashes too lately.

 

 

Version 5.9.13

Don't know if i should open a tracker ticket for you guys to work it out.

The thing is, i don't know where to start as it's doing this with various bots (on the creation process and testing them)

 

Cheers

[jason 101]

Anything you can tell us about the particulars of the crashing would be VERY helpful! 

[awesome sauce 0]

Anything you can tell us about the particulars of the crashing would be VERY helpful! 

 

Sure. I can tell you that the software is unstable. No matter what simple scripts I make on any website, they crash, fail, and throw errors. 

 

It seems to me that it's either something with a loop or a list, but I don't know.

 

Here's another script that I made that fails half way through. 

clear list(%business_page_urls)
ui text box("Business Name or Keyword:",#keyword)
ui text box("City or Zip Code:",#location)
navigate("http://www.yellowpages.com/","Wait")
wait for browser event("Everything Loaded","")
type text(<name="search_terms">,#keyword,"Standard")
type text(<name="geo_location_terms">,#location,"Standard")
click(<value="Search">,"Left Click","No")
wait for browser event("Everything Loaded","")
define Scrape URLs {
    wait for browser event("Everything Loaded","")
    wait(.2)
    if($exists(<rel="nofollow">)) {
        then {
            change attribute(<rel="nofollow">,"innertext","")
        }
        else {
        }
    }
    add list to list(%business_page_urls,$scrape attribute(<rel="nofollow">,"fullhref"),"Don\'t Delete","Global")
    if($exists(<class=w"next *">)) {
        then {
            click(<class=w"next *">,"Left Click","No")
            wait for browser event("Everything Loaded","")
        }
        else {
            stop script
            alert("Got to the end and no pages remain.")
        }
    }
}
loop while($exists(<class=w"next *">)) {
    Scrape URLs()
}

After testing my script ~5 times or so in UBot Studio (any script I have made so far), the program itself fails on everything (the script doesn't complete, errors pop up that didn't when it successfully ran before, it freezes, etc.). The only solution I have found it restarting the program completely. I don't think this should happen for $1000 software. 

 

I would really like to find a way to actually use this software productively, but I keep running into problems making it impossible. 

 

UPDATE: I was finally able to get the script to complete, but I still have the problem of needing to close the software before I run any script. 

Edited February 3, 2016 by awesome sauce

[awesome sauce 0]

So to add a little bit more about testing my script about 5 times before failure. 

 

It seems that the more times I 'test' a script in UBot Studio, the more likely it is to fail. For example, I modified the script in my last post and ran it a couple of times.  The first time I run it I will get 268 items (and is lightening fast), but if I run it anymore than that one time in UBot Studio, the script misses items to scrape, or just fails by freezing or not completing (and is very slow). 

 

Why does UBot do this?

[webpro 31]

Freezes a lot here to but i just can't pin point the problem. Can't click on things, need to restart UB. Defines crashing the bot etc...If i could only find what the bug is that's causing all of this!