nubot
-
Content Count
19 -
Joined
-
Last visited
-
Days Won
1
Posts posted by nubot
-
-
What browser are you using? Seems to work fine in 49 but not 21.
-
Isn't there a BST for this or did that get locked down?
*posts
-
Pash's Advanced Ubot 1 plugin (I believe) has this feature
Sent from my SAMSUNG-SM-N920A using Tapatalk
I did comes across that actually but then found this thread and thought I'd see if there was any update...just upgraded to dev so not really ready to spend more on plugins right now till I get more comfortable. This seems like it should be a basic feature though.
-
I know this is an old thread but any update on this?
-
Might be a stupid question but I'm thinking of upgrading to developer soon and had a few questions. I notice that there are a lot of threads of bots throwing up virus warnings and what not and I understand why this happens. In thinking about how to minimize this I had a few questions.
1. Do compiled bots in developer edition that DO NOT require the use of internet or browser call home for anything? Say if it was an app to bulk rename files, or modify images, etc.
2. Compiled bots that DO require the use of internet. Do these have to phone home?
I understand from what I've read is that you can distribute all the required files the bot needs along with your bot (or setup files?). Does this remove the need for the bot to call home to download anything?
-
just started having same errors on code that worked fine but then got those errors after upgrading to 5.9.43
Did you ever solve it?
I did resolve it but I honestly don't remember how now. It was either a bug fix (because I think I reported it), an error in my code, or I changed the browser in Ubot.
If you go to tools -> options which browser are you using? Try Chrome 29 if you're not using that one.
-
define actions needed for each widget as your calling it.
then call each define via ui buttons, this way it can process those actions as needed.
to load up the bot with a specific page, you can use onload to navigate to the page needed on load, or can use the compile option to set starting page.
Sorry this flew over my head and I can't make any sense of it :/
I created a similar program when we were looking to buy a boat. With a few modifications, you can modify it to suit your needs.
Click the 'Start' button and the bot searches craigslist boats that meet our criteria, then saves all of the urls to a list. It then visits each url so you can see the item. If you click on the 'Next' button, it visits the next item. If you click on the 'Log This Boat' button, it saves the url (along with some other info on that boat,.If you want to review all of the boats you saved, click on the 'Save This List' button.
Note: This bot was created using version 4 and uses the ui html panel, (not available in the Ubot standard version), but it would work equally well in a load html node.
ui html panel("<html><head>
<style type=\\\"text/css\\\">
.Get_Data \\\{
font-family:arial;
color:#ffffff;
font-size:15px;
font-weight:bold;
padding:6px 24px;
-moz-box-shadow:inset 0px 1px 10px #ffffff;
box-shadow:inset 0px 1px 10px #ffffff;
background:-webkit-gradient( linear, left top, left bottom, color-stop(0.05, #dfdfdf), color-stop(1, #0000cc) );
background:-moz-linear-gradient( center top, #dfdfdf 5%, #0000cc 100% );
filter:progid:DXImageTransform.Microsoft.gradient(startColorstr=\\\'#dfdfdf\\\', endColorstr=\\\'#0000cc\\\');
background-color:#dfdfdf;
-moz-border-radius:21px;
-webkit-border-radius:21px;
border-radius:21px;
border:1px solid #dcdcdc;
display:inline-block;
text-shadow:1px 1px 0px #777777;
\\\}<!----.Get_Data:hover \\\{
background:-webkit-gradient( linear, left top, left bottom, color-stop(0.05, #0000cc), color-stop(1, #dfdfdf) );
background:-moz-linear-gradient( center top, #0000cc 5%, #dfdfdf 100% );
filter:progid:DXImageTransform.Microsoft.gradient(startColorstr=\\\'#0000cc\\\', endColorstr=\\\'#dfdfdf\\\');
background-color:#0000cc;
\\\}---->
</style><style type=\"text/css\">
.Continue \{
font-family:arial;
color:#000000;
font-size:15px;
font-weight:Bold;
padding:6px 24px;
-moz-box-shadow:inset 0px 0px 0px #ffff03;
box-shadow:inset 0px 0px 0px #ffff03;
background:-webkit-gradient( linear, left top, left bottom, color-stop(0.05, #ededed), color-stop(1, #FFFF03) );
background:-moz-linear-gradient( center top, #ededed 5%, #FFFF03 100% );
filter:progid:DXImageTransform.Microsoft.gradient(startColorstr=\'#ededed\', endColorstr=\'#FFFF03\');
background-color:#0000cc;
-moz-border-radius:21px;
-webkit-border-radius:21px;
border-radius:21px;
border:1px solid #0000cc;
display:inline-block;
text-shadow:1px 1px 0px #ffffff;
\}.Continue:hover \{
background:-webkit-gradient( linear, left top, left bottom, color-stop(0.05, #FFFF03), color-stop(1, #ededed) );
background:-moz-linear-gradient( center top, #FFFF03 5%, #ededed 100% );
filter:progid:DXImageTransform.Microsoft.gradient(startColorstr=\'#FFFF03\', endColorstr=\'#ededed\');
background-color:#0000cc;
\}
</style>
<style type=\"text/css\">
.Generate-Code \{
font-family:arial;
color:#000000;
font-size:15px;
font-weight:Bold;
padding:6px 24px;
-moz-box-shadow:inset 0px 1px 10px #ffffff;
-webkit-box-shadow:inset 0px 1px 10px #ffffff;
box-shadow:inset 0px 1px 10px #ffffff;
background:-webkit-gradient( linear, left top, left bottom, color-stop(0.05, #ededed), color-stop(1, #cc0000) );
background:-moz-linear-gradient( center top, #ededed 5%, #cc0000 100% );
filter:progid:DXImageTransform.Microsoft.gradient(startColorstr=\'#ededed\', endColorstr=\'#cc0000\');
background-color:#ededed;
-moz-border-radius:0px;
-webkit-border-radius:0px;
border-radius:0px;
border:1px solid #dcdcdc;
display:inline-block;
text-shadow:1px 1px 0px #ffffff;
\}.Generate-Code:hover \{
background:-webkit-gradient( linear, left top, left bottom, color-stop(0.05, #cc0000), color-stop(1, #ededed) );
background:-moz-linear-gradient( center top, #cc0000 5%, #ededed 100% );
filter:progid:DXImageTransform.Microsoft.gradient(startColorstr=\'#cc0000\', endColorstr=\'#ededed\');
background-color:#ededed;
\}
</style>
</head>
<body><button class=\"Get_Data\" onclick=\"ubot.runScript(\'Clear Variables()\')\">Start</button>
<br>
<button class=\"Continue\" onclick=\"ubot.runScript(\'NextItem()\')\">Next Item</button>
<br>
<button class=\"Generate-Code\" onclick=\"ubot.runScript(\'Log This Boat()\')\">Log This Boat</button>
<br>
<button class=\"Generate-Code\" onclick=\"ubot.runScript(\'Email List()\')\">Save This List</button></center><br>
</body></html>", 200)
Clear Variables()
define Clear Variables {
set(#itemnumber, 0, "Global")
set(#URLNumber, 0, "Global")
clear list(%urls)
clear list(%boats1)
clear list(%Boats To Check)
Get URLs()
}
define Get URLs {
set user agent("Firefox 6")
allow popups("Yes")
navigate("http://jerseyshore.craigslist.org/search/boo?max_price=4000&min_boat_length_overall=18&max_boat_length_overall=21&boat_propulsion_type=2", "Wait")
wait(2)
add list to list(%boats1, $scrape attribute(<innertext=w"*">, "fullhref"), "Delete", "Global")
set(#itemnumber, 21, "Global")
loop($subtract($list total(%boats1), 31)) {
add item to list(%urls, $list item(%boats1, #itemnumber), "Delete", "Global")
increment(#itemnumber)
}
set(#URLNumber, 0, "Global")
Boat Data()
}
define Boat Data {
navigate($list item(%urls, #URLNumber), "Don\'t Wait")
}
define NextItem {
increment(#URLNumber)
Boat Data()
}
define Log This Boat {
add item to list(%Boats To Check, $url, "Don\'t Delete", "Global")
add item to list(%Boats To Check, $page scrape("<span class=\"postingtitletext\">", " - <span class=\"price\">"), "Don\'t Delete", "Global")
add item to list(%Boats To Check, $page scrape("<span class=\"price\">", "</span>"), "Delete", "Global")
add item to list(%Boats To Check, $page scrape("<span class=\"price\">", "</span>"), "Don\'t Delete", "Global")
add item to list(%Boats To Check, $page scrape("<small>", "</small>"), "Don\'t Delete", "Global")
wait for element(<class="reply_options">, "", "Appear")
add item to list(%Boats To Check, "- - - - - - - - ", "Don\'t Delete", "Global")
}
define Email List {
save to file("Boat-List.txt", %Boats To Check)
}
I will play around with this, thank you for sharing your script!!
-
To clarify what I mean, say I wanted to pull up some Google search results and then save the URL of only specific sites, is there a way to allow for user interaction with the browser?
e.g.
1. Load up a Google search page for "widgets"
2. You get your search results:
widget site 1
widget site 2...
widget site 3.. etc.
Would there be a way to allow the user to click either directly on the link and have it added to a list, or would there be a way to include a UI element such as a button that the person could click to "add url" to a list? Add site 1 & 2 but not 3.
Thanks in advance!
-
I was trying to scrape a user's videos from Youtube (title+url). However, the bot seems to crash after a certain amount of time (pulled about 4700 records). I'm getting 2 types of errors.
1. Error converting value true to type
2. Cannot deserialize the current JSON array
I saw a thread here which didn't really solve anything: http://network.ubotstudio.com/forum/index.php/topic/17342-ubot-error-cannot-deserialize-the-current-json/
Any ideas as to what causes these errors?
Sample page: https://www.youtube.com/user/GamingCurios/videos
Thanks.
-
Thanks, works great! Now have to work on some filtering...
-
I'm trying to build a simple YT title and url scraper and am running into a few issues.
1.) I'm not quite sure if I'm using the best attribute possible to scrape my data...it seems that the last 2 bots I made died the next day even though I used wildcards. I think it may be good now but guess I'll find out tomorrow
2.) I'm running into an issue with the title and url not matching up at some point, my guess is due to it not being able to find the page attribute. It could just be something in my script though. I suspect one culprit might be that I'm using "don't delete" for titles but "delete for urls". I did this because for titles, they can be the same sometimes and for urls, I put don't delete because for some reason it was spitting out double the amount of records (could be an error in my script though).
What possible checks could I add to prevent the mismatching of the title and urls. What would be the best way to handle this? Not really sure how to tackle this one.
If you'd like to reproduce my error go to youtube.com and search for something, then run the script (don't forget to change output directory). It *might* run fine for the first 2 or 3 pages but if you let it run through about 5-10 that's usually where something screws up and I end up with the titles and urls not matching properly beyond the point of the initial failure
To reproduce the double records simply change the %fullurl list to "don't delete".
Ready to get my bot ripped apart
Here is my code. Thank you in advance!
clear all data define Scrapes Titles and URLs { add list to list(%title,$scrape attribute(<outerhtml=w"<a href=\"/watch?v=*\" class=\"yt-uix-sessionlink yt-uix-tile-link yt-ui-ellipsis yt-ui-ellipsis-2*\" title=*">,"title"),"Don\'t Delete","Global") add list to list(%url,$scrape attribute(<outerhtml=w"<a href=\"/watch?v=*\" class=\"yt-uix-sessionlink yt-uix-tile-link yt-ui-ellipsis yt-ui-ellipsis-2*\" title=*">,"href"),"Don\'t Delete","Global") with each(%url,#url) { add item to list(%fullurl,"http://www.youtube.com{#url}","Delete","Global") } add list to table as column(&TitlesURLs,0,0,%title) add list to table as column(&TitlesURLs,0,1,%fullurl) save to file("DIRECTORYGOESHERE\\testcsv.csv",&TitlesURLs) } loop while($exists(<data-link-type="next">)) { Scrapes Titles and URLs() click(<data-link-type="next">,"Left Click","No") wait for browser event("Everything Loaded","") } -
clear all data add list to list(%MyList1,$list from text("a,b,c,d",","),"Delete","Global") with each(%MyList1,#Data) { add item to list(%MyList2,"Prefix {#Data}","Don\'t Delete","Global") } alert(%MyList2)Thank you!!
-
I feel like this should be easy but I keep banging my head on the desk. I'm scraping a list of URLs and they are path relative so I need to add a prefix, eg. url: blahblah.html and I need to add http://blahsite.com/
I can't seem to figure out how to use the list or table functions to insert the http://blahsite.com/ part.
So let's say I have:
10 URLs I scraped. I want to add them to a table as such: PrefixURL
I feel like I should be doing something with loops here...
Thanks in advance.
-
Thank you!
-
Hello,
I am unsure when I should be hitting the quote button in my nodes. I ran into an issue yesterday where it came in handy so I *think* I understand it but just wanted to learn of the best practices.
My issue yesterday was that I was outputting a user & pass to a text file in the form of user / pass. When I didn't use the quotes it got an error because it tried dividing. Should I be using quotes on everything that won't be used in calculations or is it more of a quote as you need basis like my above example?
Thanks guys <3
-
Nevermind, figure it out. Tools -> options.
Thanks!
-
I had to switch to the lower browser version, 21 I think it is.
Forgive my ignorance as I just recently re-installed ubot after not using it for a very long time. How do I change the browser version?
Thanks.
-
I just submitted a ticket about this. Having the same issue. Were you able to get it resolved?
-
1
-
Ubot Studio X — You'll Have Triple The Browser Firepower.
in General Discussion
Posted
^^ This.
One of my most used bots is not showing node view and is missing the entire UI. You're going to get buried with support tickets at this rate and it's clearly not an issue with people's bots.