Mart
-
Content Count
29 -
Joined
-
Last visited
Posts posted by Mart
-
-
This did start recently and I have version 5.9.44. This happens even when I am not using threads.
I have used ubot for 6 years and accept it hangs whenever it feels like but this has been constant lately.
-
Ubot keeps closing every time I use the attribute selector and it's freezing/crashing a lot even when I am not using the selector.
It's not stable/useable for me at the moment. Anybody got any advice?
It's not even the size of my scripts because this can happen when I am just starting a new script and I have got 8gb RAM.
Thanks
-
sorted it now
-
fixed it now
-
I have been using the Pinterest API to post images using the http post plugin created by aymen. Does anyone know if it's possible to repin images through the api or a normal http request because I can't find any information on how to do it.
-
Thanks Dan and enjoy your break, I got 2.0 working now anyway. There was just a few code typo's no big deal. I have also written a script to scrape board followers using the http plugin if anyone is interested (PM me). It works great
-
I downloaded 2.0. Please can you send me 2.1
-
there is some genuine code mistakes in there and I think I might need the latest version of the http plugin
-
there is code errors
-
just bought this, I hope it works
-
I just can't set the cookie for some reason.
ui text box("Email",#email)
ui text box("Password",#password)
set(#start,$plugin function("HTTP post.dll", "$http post", "https://www.pinterest.com/resource/ContextLogResource/create/", "", "", "", "", ""),"Global")
set(#load,$plugin function("HTTP post.dll", "$http response headers"),"Global")
set(#full cookie,$find regular expression(#load,"(?<=Set-Cookie\\|).*(?=\\b)"),"Global")
plugin command("HTTP post.dll", "http set headers", "Accept", "application/json, text/javascript, */*; q=0.01")
plugin command("HTTP post.dll", "http set contenttype", "application/x-www-form-urlencoded; charset=UTF-8")
plugin command("HTTP post.dll", "http set headers", "Cookie", #full cookie)
set(#login,$plugin function("HTTP post.dll", "$http post", "https://www.pinterest.com/resource/UserSessionResource/create/", "source_url=%2Flogin%2F%3Freferrer%3Dhome_page&data=%7B%22options%22%3A%7B%22username_or_email%22%3A%22{#email}%22%2C%22password%22%3A%22{#password}%22%7D%2C%22context%22%3A%7B%7D%7D&module_path=App%3ELoginPage%3ELogin%3EButton(text%3DLog+in%2C+size%3Dlarge%2C+class_name%3Dprimary%2C+type%3Dsubmit)", "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:38.0) Gecko/20100101 Firefox/38.0", "https://www.pinterest.com", "", ""),"Global") -
I will try that out thanks, I missed this reply
-
I can't seem to login to bing ads using http requests.
You can login into bing ads with your microsoft (hotmail) account details:
Please could someone take a look at this code for me:
plugin command("HTTP post.dll", "http cookies folder", "C:\\")set(#login page, $plugin function("HTTP post.dll", "$http get", "https://login.live.com/ppsecure/post.srf?wa=wsignin1.0", "", "", "", ""), "Global")set(#cookie, $plugin function("HTTP post.dll", "$http cookie response"), "Global")set(#login_url, "https://login.live.com/ppsecure/post.srf?wa=wsignin1.0", "Global")plugin command("HTTP post.dll", "http cookies string", #cookie)plugin command("HTTP post.dll", "http set headers", "Set-Cookie", #cookie)set(#bing_login_ms, $plugin function("HTTP post.dll", "$http post", #login_url, "login=EMAIL%40ADDRESS&passwd=PASSWORDHERE&type=11&PPFT=ClgFK5JnCIIYUGXv2AbyimI*tC5eq4LukWzEjZgmHBG5gLhbF8kQshV8RFVykAJ*FQFo8UxuOzwtdtle5fP0RjXVdylXl9sK*3A%21WnNr5MG*pI0CdnZxfsIfOwkyUDss9B4dqYToViL3U*ryDY4KSNsHU2vktw1BZaXCBppojikoCQFp1u2ZBeCtVPgDT6Zt*zE61Ry6SJvpY0Rkc7562QuUPQ3DpoNXHZBilQlQaY4N&PPSX=PassportRN&idsbho=1&sso=0&NewUser=1&LoginOptions=3&i1=0&i2=1&i3=19745&i4=0&i7=0&i12=1&i13=0&i14=744&i15=2351&i17=0&i18=__Login_Strings%7C1%2C__Login_Core%7C1%2C", "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:35.0) Gecko/20100101 Firefox/35.0", "https://login.live.com/login.srf?wa=wsignin1.0&rpsnv=12&ct=1421581413&rver=6.1.6206.0&wp=MBI_SSL&wreply=https:%2F%2Fsecure.bingads.microsoft.com%2FLogin%2FLive%3FskipMigrationFilter%3Dtrue&lc=1033&id=288120", "", ""), "Global")load html(#bing_login_ms) -
All sorted now, thanks guys
-
Cheers Dan, I will test that out. Just trying to get my head round threading with local lists.
-
Thank you LoWrIdErTJ - BotGuru, I have been running multiple instances my compiled bot because I can't get local lists to work. I have been running the bots 24/7 with no captchas or proxies The bot creates 5 possible email addresses from the info found then runs them through a verifier.
Does anyone have a local list threading example because I am still stuck on this.
-
Thanks you both, the dictionary plugin really helped and it is scraping great now. The only thing I can't get to work now is reading/writing with a local list, it never seems to work no matter what I do. Anyone have an example using the dictionary plugin?
-
Please could somebody help with this, I am trying to scrape linkedin profile data into a table, the way I have threaded this is not right because, the data doesn't match the profile scraped on some rows (profile list attached):
ui drop down("Threads", "5,10,20,30,40,50", #INPUT Threads)
ui stat monitor("Threads (Active/Total):", "<b>{#THREADS Active}/{#THREADS Max}</b>")
ui stat monitor("COUNT:", #COUNT)
ui stat monitor("Records:", $table total rows(&li database))
plugin command("SocketCommands.dll", "socket container") {
set(#FOLDER Root, $special folder("Application"), "Global")
clear table(&li database)
set table cell(&li database, 0, 0, "Company Name")
set table cell(&li database, 0, 1, "First Name")
set table cell(&li database, 0, 2, "Last Name")
set table cell(&li database, 0, 3, "Current Role")
set table cell(&li database, 0, 4, "Industry")
set table cell(&li database, 0, 5, "Employees")
set table cell(&li database, 0, 6, "Founded")
set table cell(&li database, 0, 7, "Website")
set table cell(&li database, 0, 8, "Company Profile")
set table cell(&li database, 0, 9, "Personal Profile")
set(#THREADS Max, #INPUT Threads, "Global")
set(#RESULTS ROW, 1, "Global")
clear list(%PROFILES)
add list to list(%PROFILES, $list from file("{#FOLDER Root}\\profiles.txt"), "Delete", "Global")
set(#PROFILES ROW, 0, "Global")
set(#COUNT, $list total(%PROFILES), "Global")
if($comparison(#THREADS Max, ">", #COUNT)) {
then {
alert("You need to have more profiles than threads.")
stop script
}
else {
}
}
comment("Reset counter to 0.")
set(#THREADS Active, $plugin function("Threads Counter.dll", "threads counter", "reset"), "Global")
comment("Main Threading Loop")
loop while($comparison(#COUNT, ">", 0)) {
if($comparison($plugin function("Threads Counter.dll", "threads counter", "read"), "<", #THREADS Max)) {
then {
comment("Increment Number Of Threads And Store Value to UBot Variable.")
set(#THREADS Active, $plugin function("Threads Counter.dll", "threads counter", "increment"), "Global")
if($comparison(#PROFILES ROW, ">=", $list total(%PROFILES))) {
then {
set(#PROFILES ROW, 0, "Global")
}
else {
}
}
THREAD START(#PROFILES ROW, #RESULTS ROW)
increment(#PROFILES ROW)
increment(#RESULTS ROW)
decrement(#COUNT)
}
else {
wait(0.2)
}
}
}
comment("Thread Command")
define THREAD START(#PROFILES ROW, #RESULTS ROW) {
thread {
SCRAPE LINKEDIN(#PROFILES ROW, #RESULTS ROW, #PROXY)
set(#THREADS Active, $plugin function("Threads Counter.dll", "threads counter", "decrement"), "Global")
}
}
}
comment("Wait For Threads To Close")
set(#THREADS Active, $plugin function("Threads Counter.dll", "threads counter", "read"), "Global")
loop while($comparison(#THREADS Active, ">", 0)) {
set(#THREADS Active, $plugin function("Threads Counter.dll", "threads counter", "read"), "Global")
wait(2)
}
save to file("{#FOLDER Root}\\results.csv", &li database)
stop script
define SCRAPE LINKEDIN(#PROFILES ROW, #RESULTS ROW, #PROXY) {
set(#li profile, $plugin function("HTTP post.dll", "$http get", $list item(%PROFILES, #PROFILES ROW), "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:28.0) Gecko/20100101 Firefox/28.0", "", "", ""), "Global")
set(#li profile, $replace regular expression($text from list($list from text(#li profile, $new line), " "), "\\s+", " "), "Global")
set(#company_name, $find regular expression(#li profile, "(?<=<span class=\"org summary\">).*?(?=\\<\\/span>.*<dt id=\"overview-summary-past-title\")|(?<=<span class=\"at\">at <\\/span>).*?(?=<.*dt id=\"overview-summary-past-title\")"), "Global")
set(#first_name, $find regular expression(#li profile, "(?<=class=\"given-name\">).*?(?=<)"), "Global")
set(#last_name, $find regular expression(#li profile, "(?<=class=\"family-name\">).*?(?=<)"), "Global")
set(#current_role, $trim($replace regular expression($trim($find regular expression(#li profile, "(?<=<ul class=\"current\">).*?(?=<span)")), "<li>", $nothing)), "Global")
set(#check, $find regular expression(#li profile, "(?<=class=\"company-profile-public\" href=\").*?(?=\"><span class=\"org summary\">.*<dt id=\"overview-summary-past-title\")"), "Global")
if($comparison(#check, "=", $nothing)) {
then {
set(#company_profile, "-", "Global")
clear list(%website)
add list to list(%website, $list from text($find regular expression(#liC profile, "(?<=\\/redir\\/redirect\\?url=)http%3A%2F%2F(www%2(E|F)|).*?(?=(&url|%2F|&))"), $new line), "Delete", "Global")
if($comparison($list total(%website), "=", 0)) {
then {
set(#website, "-", "Global")
}
else {
set(#website, $list item(%website, 0), "Global")
}
}
}
else {
set(#company_profile, "http://www.linkedin.com{$find regular expression(#li profile, "(?<=class=\"company-profile-public\" href=\").*?(?=\"><span class=\"org summary\">.*<dt id=\"overview-summary-past-title\")")}", "Global")
plugin command("HTTP post.dll", "http auto redirect", "Yes")
plugin command("HTTP post.dll", "http max redirects", 2)
plugin command("HTTP post.dll", "http set headers", "azccept", "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8")
set(#company_profile, $replace(#company_profile, "amp;", $nothing), "Global")
set(#liC profile, $plugin function("HTTP post.dll", "$http get", #company_profile, "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:28.0) Gecko/20100101 Firefox/28.0", $list item(%PROFILES, #PROFILES ROW), "", ""), "Global")
set(#liC profile, $replace regular expression($text from list($list from text(#liC profile, $new line), " "), "\\s+", " "), "Global")
set(#website, $find regular expression(#liC profile, "(?<=nofollow\">).*?(?=</a>.*(Industry|Branche)<)"), "Global")
set(#industry, $trim($replace regular expression($trim($find regular expression(#liC profile, "(?<=<dt>Industry</dt>).*?(?=<\\/dd>)|(?<=<dt>Branche</dt>).*?(?=<\\/dd>)")), "<dd>", $nothing)), "Global")
set(#employees, $trim($find regular expression(#liC profile, "(?<=Company Size</dt> <dd>).*?(?=\\s*.employee)|(?<=Unternehmensgröße</dt> <dd>).*?(?=\\s*.Mitarbeiter)")), "Global")
set(#founded, $trim($find regular expression(#liC profile, "(?<=Founded</dt> <dd>).*?(?=<\\/dd>)|(?<=Gründungsdatum</dt> <dd>).*?(?=<\\/dd>)")), "Global")
}
}
set(#company_name, $replace(#company_name, "amp;", $nothing), "Global")
set(#first_name, $replace(#first_name, "amp;", $nothing), "Global")
set(#last_name, $replace(#last_name, "amp;", $nothing), "Global")
set(#current_role, $replace(#current_role, "amp;", $nothing), "Global")
set(#industry, $replace(#industry, "amp;", $nothing), "Global")
set(#employees, $replace(#employees, "amp;", $nothing), "Global")
set(#founded, $replace(#founded, "amp;", $nothing), "Global")
set table cell(&li database, #RESULTS ROW, 0, #company_name)
set table cell(&li database, #RESULTS ROW, 1, #first_name)
set table cell(&li database, #RESULTS ROW, 2, #last_name)
set table cell(&li database, #RESULTS ROW, 3, #current_role)
set table cell(&li database, #RESULTS ROW, 4, #industry)
set table cell(&li database, #RESULTS ROW, 5, #employees)
set table cell(&li database, #RESULTS ROW, 6, #founded)
set table cell(&li database, #RESULTS ROW, 7, #website)
set table cell(&li database, #RESULTS ROW, 8, #company_profile)
set table cell(&li database, #RESULTS ROW, 9, $list item(%PROFILES, #PROFILES ROW))
} -
Yeah the upload comes before the script above and that is where I scrape all the variables to put into the post
-
-
The site I am having trouble with is wix.com. I can login and post data no problem. I am just getting an error from this part of my script:
plugin command("HTTP post.dll", "http set contenttype", "application/xml; charset=UTF-8")
plugin command("HTTP post.dll", "http set headers", "accept", "application/json, text/plain, */*")
set(#post image, $plugin function("HTTP post.dll", "$http post", "http://editor.wix.com/media/private/add", "<mediaItemList><mediaItem fileName=\"{#filename}\"\\n
originalFileName=\"{#original}\"\\n
fileSize=\"{#filesize}\"\\n
mimeType=\"image/jpeg\"\\n
sourceName=\"user\"\\n
version=\"2\"\\n
iconURL=\"{#icon}\"\\n
sourceURL=\"undefined\"\\n
mediaType=\"picture\"\\n
width=\"{#width}\"\\n
height=\"{#height}\"\\n
/></mediaItemList>", "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:27.0) Gecko/20100101 Firefox/27.0", "http://editor.wix.com/static/services/media-gallery-ng/0.116.0/assets/media_gallery/index.html?mediaGalleryStaticBaseUrl=http://static.wix.com/services/media-gallery-ng/0.116.0//", "", ""), "Global")It does upload initially because I am able scrape those upload file variables right before this piece of code, it just won't post the information to make the image become live on the site.
-
Does anybody know what this means?
{"errorCode":-1019,"errorDescription":"[runtime][WARNING][JAXB] c.w.f.o.JAXBRuntimeException - Unmarshaling failed","success":false,"payload":null}
Thanks
-
Thank you for this gotgetta after watching your video I was able to do the same for facebook easily, here is the code if anybody wants to use it
ui text box("Username:", #user)
ui text box("Password:", #pass)
plugin command("SocketCommands.dll", "socket container") {
plugin command("SocketCommands.dll", "socket set header", "User-Agent", "Mozilla/5.0 (Windows NT 6.2; WOW64; rv:24.0) Gecko/20100101 Firefox/24.")
plugin command("SocketCommands.dll", "socket navigate", "GET", "http://facebook.com")
set(#token, $find regular expression($plugin function("SocketCommands.dll", "$socket page html"), "(?<=lgnrnd\" value=\").*?(?=\")"), "Global")
plugin command("SocketCommands.dll", "socket add parameter", "email", #user)
plugin command("SocketCommands.dll", "socket add parameter", "pass", #pass)
plugin command("SocketCommands.dll", "socket add parameter", "lgnrnd", #token)
plugin command("SocketCommands.dll", "socket navigate", "POST", "https://www.facebook.com/login.php?login_attempt=1")
load html($plugin function("SocketCommands.dll", "$socket page html"))
} -
Links are not working, anyone got a working script for spinner chief api?
Ubot Keeps Freezing And Closing
in General Discussion
Posted
Thanks heopas, it has started to freeze now when the script reaches the wait command (no threads)???