BeerNut
-
Content Count
155 -
Joined
-
Last visited
-
Days Won
6
Posts posted by BeerNut
-
-
Firstly I never mailed you.
That was Dan who I spoke with and helped him setup a plan of action
to correct things that were said to make things right for you and others.
Sorry I didn't mean you as in you yourself. I had to quote your comment to reply to you and then the rest of my reply was I guess to Dan so he was the main "you". You are the original poster of EXB so I don't really know how you are involved if at all anymore. You seem to be at least an advisor. But yeah not really intended for all of that to be to you personally but to the EXB team if there is one.
-
That's correct with the above that Dan is going to be doing to take care of things.
I had a good conversation with him on how things needed to be rectified and a plan to execute things.
Also with plugins like that from Aymen, no disrespect to Aymen at all, but its one hes been sitting on for a while
His main product is ME, and I cant see the External plugin of his being updated on a continual basis
Plugins of this size and amount of functionality and the need to keep up to date with released libraries selenium, chromium etc require a good bit of time
Specially so if something gets removed on the end of the library, and you have to patch things in to continue working as expected.
Well Aymen gave me the C# source code to the whole thing and it has no call backs to his server. This means I control it and I can update the selenium if I want to. I was not going to buy it, because I was happy with v1 EXB but then you emailed me saying you were locking me out. So I paid Aymen yesterday instead of you, of course now you flip flop on it after 24hrs. Not smart.
You also said that this new version and 1.4 are basically going to call back to your server on every bot they are in? So all of my customers bots they purchased from me are now going to call back to your server on every load? Fuck that. What the heck am I supposed to do if/when your server has a hiccup, routing error, hardware problem etc. Most dedicated servers claim 99% uptime but how am I supposed to tell my clients in that 1% that totally out of my control some guy on a message board I gave money to is now holding up your business and costing us both money? It is already enough trouble when my own license server has problems I can not afford to have to deal with yours as well.
Id love this 1.4 for free but since your moving it to that new license server and since I cant allow you to call back to all of my clients. So I guess I didn't screw up paying Aymen after all because with this move from 1.3 to 1.4 I don't even have the 1 year time you said I had. Now I have to update all my bots off of your system and into Aymen's before the lock out? I should also mention the privacy concern on this issue. I have no idea what you are collecting and sending back and you could change that anytime without me knowing. I have had customers that actually packet sniffed the bot that I sold to them! Wait until I get the email asking why my bot is talking to server on load. uggh.
Unless I am wrong? Because you said v2 has call backs on every bot. Yes, you will say "But Ubot has a call back!". Yes, but it only has one for me to open uBot not for every client that I have. I have my own inno installer and I supply all needed files as part of it so it doest not call to ubot when a customer runs/opens the complied bot. I want my clients 2 years from now to be able to use the software I sold them without having to rely on 3rd parties. Ubot goes down, you will go down, even my own server goes down.
This whole thing is a disaster. I have no idea why you made any of these choices. Was there really so many people that only paid for 1 month that all of us are grouped into this crazy system? Why the hell did you switch to a month subscription price model then? Why didn't you just make a major version every 6 months or hell only offer 6 month subscriptions?! If you had just said hey v2 is out now and you need to buy it, its not free, its $250 and will work the same as v1 did I would have freaking paid you.
-
1
-
-
Holy shit what is with the email about you canceling and locking out ALL EXB 1 clients and forcing us into buying your new subscription? What is this crap about "running the backend" you mean the license check server that uses probably no server resources at all? What part of exbrowser is cloud based? How much does this "backend infrastructure" cost you per month that you are complaining about?
This is some serious crazy shit you rarely hear of anyone so bluntly locking out customers and forcing a service on them. I see now why Aymen is emailing me constantly about his 1 time payment remote browser system. He is trying to take clients from you since you have gone nuts it seems.
I know your plan is somehow to make us all pay into the new system and how that will support you but I had planned to continue to use the portable browsers and exbrowser for clients without having to pay you $30 a month. Since it wasn't needed as far as I knew right now. I thought I could continue to use the service that I paid for. No part of the plugin is cloud based, if I only used the xpath scrape for years it wouldn't cost you a thing.
How can we possibly trust you to purchase you new plan when you pull a stunt like this? Absolutely NONE of my other paid plugs have done this. In fact I don't think I have ever purchased a software that did either. Worst case I thought I might use python to use selenium but you would be locking me out of other stuff I use as well. You are seriously out of your mind with this plan.
-
3
-
-
It's not a bug. You are simply not clearing the data at the beginning of your loop. The way that you have it now when your script loops the response data from the previous request is being sent along with the next GET request. Either clear the cookies and headers or use the thread command to run a new instance on each loop. See this code below:
ui text box("Proxy:", #Proxy) clear list(%ips) loop(20) { set(#running, "true", "Global") thread { testProxy() set(#running, "false", "Global") } loop while($comparison(#running, "=", "true")) { wait(0.2) } } define testProxy { plugin command("HTTP post.dll", "http auto redirect", "Yes") plugin command("HTTP post.dll", "http max redirects", 5) set(#soup, $plugin function("HTTP post.dll", "$http get", "https://www.whatsmyip.com/", "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.77 Safari/537.36", "", #Proxy, ""), "Local") add item to list(%ips, $plugin function("File Management.dll", "$Find Regex First", #soup, "(?<=id=\"shownIpv4\">).*?(?=<\\/p>)"), "Don\'t Delete", "Global") set(#soup, $nothing, "Local") }I don't have Storm Proxies but it should work when you run it.
This is not the problem. I have tested it with clearing the local variables as well, even though that should make no sense to begin with because each new get should overwrite the last one and each one is a local variable in its own define like you showed. But yeah, I did try that as well. I also used clear objects and clear headers with http post. I tried to make the gets more dynamic by adding random variables appended to the urls, random generated referrers as well. Nothing has worked. Also if it was a problem with clearing the variable each time why would it work only with a 120 second wait between requests?
What I have done is I am now using python within ubot and using python requests. By doing this the whole thing works as it should and each request gets its own ip, no 120 second wait is needed. I made no other changes to any testing scripts other than that.
https://luminati.ioproxy service which is back connect rotating has a free trial. You can test all of this out yourself and see if you can find a solution.
-
1
-
-
Ok I am un deleting this since there seems to be no solution. This links back to an issue I found a before but now no longer works either here is my old post http://network.ubotstudio.com/forum/index.php/topic/22259-stormproxies-and-http-post/
So basically uBot seems to have some sort of cache when you use either HTTP Post Get or Heopas HTTP Get. Both plugins get requests have the same problem. What is happening is that if you use a back connect proxy rotate service you will constantly get the same cached source code returned to you.
Here is the set up. I have a single loop that loops 50 times. It sets #source as the http get response. The http get is using a proxy that when you connect to it each time a different IP address will be used. I then add #source to a list to keep track of it. The page I am requesting is "http://lumtest.com/myip.json"which will report back json about your ip on that request.
loop 50
set #source to http get (using the single connect proxy)
add #source to list
If I run this all 50 items in the list will be the exact the same. They will all have the same 50 ip addresses.
Now here is the next issue. If I use this exact same code with no changes other than a wait of 120 seconds the problem is fixed. If you wait 5 seconds no, if you wait 10 no, 30 no, it only works if I wait 120 seconds. With a 120 second wait each list item from the loop will be a unique IP just as the service says.
loop 50
set #source to http get (using the single connect proxy)
add #source to list
wait 120
So lets test the service as well. If I just make terminal curl requests it gives a unique ip every time. If I use their service with python and scrape it works fine. It is ONLY with uBot where each request is not unique. There is some sort of cache per request per IP address that it is keeping. Because if we use normal proxies of course every request works fine.
I have also tested this on two other back connect services it is always the same error of the cache response.
So there is some sort of cache nonsense on each of these requests that assumes you will not be requesting the same webpage with the same proxy (back connect remember) and some how expect a new response.
Edit: I will mention that if I use the same loop above but instead I use Exbrowser with a new chrome on each loop it will get a new proxy ip like it should with no problems. Open chrome, get page, close chrome no delay works.
-
How does this plugin expect proxies to be entered?
I am trying Crawlera from Scrapinghub and they only have a user(api key) and no pass. Below is the structure.
proxy.crawlera.com:8010:MYAPIKEY:
With http post it works but the same proxy input into heopas http get it does not work.
-
Looks like a issue with http post. If I change it to Heopas and this code it works fine again.
start() define start { loop(20) { set(#soup,$plugin function("HeopasCustom.dll", "$Heopas HTTP Get", "http://mysite.com/ip.php", "stormproxy-ip", "", "", "", 15),"Global") add item to list(%ips,#soup,"Don\'t Delete","Global") } } -
start() define start { loop(20) { testloop() add item to list(%ips,#soup,"Don\'t Delete","Global") } } define testloop { set(#soup,$plugin function("HTTP post.dll", "$http get", "http://mysite.com/ip.php", "", "", "stormip", ""),"Global") }Something like this also doesn't work. I made a simple php file to host at my site that only reports ip.
start() define start { thread { loop(20) { set(#soup,$plugin function("HTTP post.dll", "$http get", "http://mysite.com/ip.php", "", "", "storm-ip", ""),"Global") add item to list(%ips,#soup,"Don\'t Delete","Global") } } }also doesn't work.
Something about http post isn't being counted as a unique request when using their service.
-
Has anyone gotten uBot to work with StormProxies or other 'backconnect' provider and ubot? Below is a sample code i was testing. They say that when you make a http request to your single ip they provide you that they rotate the ip on the backend on each connection from their pool of 70k. When testing the code below though the IP does not change on each request in the loop. But if you stop the program wait a bit and start it again it IP will change but then repeat the new IP over and over.
loop(20) { set(#soup,$plugin function("HTTP post.dll", "$http get", "https://www.whatsmyip.com/", "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.77 Safari/537.36", "", "stormproxy-ip", ""),"Global") add item to list(%ips,$plugin function("File Management.dll", "$Find Regex First", #soup, "(?<=Your IP<span class=\"hidden-sm-down\"> Address</span> is:</h1><p class=\"h1 boldAndShadow\">).*?(?=</p>)"),"Don\'t Delete","Global") set(#soup,$nothing,"Global") }On the other hand if I use this code and the normal ubot browser then it works fine and changes on every connection.
loop(20) { change proxy("ip-address") navigate("https://www.whatsmyip.com/","Wait") set(#soup,$document text,"Global") add item to list(%ips,$plugin function("File Management.dll", "$Find Regex First", #soup, "(?<=Your IP<span class=\"hidden-sm-down\"> Address</span> is:</h1><p class=\"h1 boldAndShadow\">).*?(?=</p>)"),"Don\'t Delete","Global") }Anyone have any ideas?
-
1. What about development is difficult?
uBot user base seemed to peak a few years back, forms are slowly dying. This makes finding solutions harder compared to stack and other languages. It also means we have less plugin developers and less financial reason for them to make them. uBot corporate hasn't made any effort in some time platform is slowly dying.
2. What frustrates you?
Buy ubot, Buy Pro, Buy Dev, then need to also buy 1k+ worth of plugins and scripts over the years just to make ubot more usable. Ubot seems to have relied this whole time on other people selling plugins to expand its capability and has done very little if anything themselves to expand the program.
Currently trying to look into moving my entire system off meters locker system now and roll my own so i can code sign and look more professional. Ive spent over an hour looking through what i can to figure out if I can make a themed html popup prompt that would give me 2 fields for the user to enter on load. User/Pass. Seems its not possible at all.
Basic ubot prompt looks like crap, cant title the prompt, cant change colors,no image bg, no sizing, nothing. Default prompt theme may make people realize i use uBot (thanks dev license). Turns out there are 2 plugins (yours is one) that would even let me change the colors of a prompt and the title.
So that is another $100 I need to spend just to change the color and text of a prompt window. Like seriously in the last 5 years uBot couldn't add this to the program? You seemed to have no trouble doing it. So why i am still paying for updates? This goes for all basic functions that are in plugins and totally missing from uBot. Need to find the first instance of a regex? That will be $100. Thank god for Heopas only plugin that didn't cost $100.
3. What takes too long?
Seemingly a lot, like the above prompt problem. You never know until you want to try something new that you have never done.
4. What do you think could speed up your development?
Not needing to browser the Sell section of the form every very weeks to see what plugin i am missing to do the thing i need ubot to do.
5. What do you think could make your development easier?
If ubot took a bit of a page from apple (took popular apps added to base OS) at started to add plugins to the code code. Pay them off, only take ones years old, ive got no idea. Do something at least. How about a drop down to make my prompt white at the very least?
Yes i am well aware 6 has exbrowser(lite) in it, but 6 is unstable for now and everyone bought exbrowser because we had to years ago.
Need to use (your) ubot launcher to launch each time, but don't know you need one of the plugins before you start or forget which ones contained what commands. Save, close, add plugin, reload.
6. What prevents you from building a certain bot?
Memory clearing, anti-virus programs, site scraper/bot detection, bit of plugin mess as well now that i have so many.
7. What made my development easier?
Heopas just added in his latest update the ability to collapse code when in the code viewer. This has saved me extreme amounts of time since it was added. It also serves as a prime example of basic functionality that nearly all code editors have by default. Another thing that ubot couldn't be bothered to add to their program in all these years. I didn't even know it could be possible to add something like that, then one guy in his free time added to the program as a plugin for free.
8. What made me fee sick?
When i get a new email from seth thinking its something finally about ubot and its him trying to sell me on his newest make money online scheme or his private $4000 class, or his magic upsell templates, or various other non-related crap. Meanwhile normal other people like Hepoas are adding basic functionality to his system.
Edit: I was a bit bothered by not being able to do what i wanted in the program and the idea of needing to possibly pay for more plugins and more scripts adding up to $300 just to try a new license system. So this post came across far more angry than it should have. I do want to say that I still am 100% thankful for uBot and it existing because it enabled me to make a living selling bots/services alone. So the $100 a pop plugins are just part of business. If you were not making money with your bots then i feel most of these features would be totally out of reach to most users.
-
6
-
-
Attached are the two test csv files which show what i was talking about above.
-
Anyone have a way to use the large table in a data grid? I need a way to show the progress to users when running the bot.
Edit: I switched over to using the "Add Row" to the data grid which works but also doesn't support a row number gotta find a way to work around that.
When using 'save to file' and 'return large table csv' I can double click the final file and it opens in excel looks good but anything with a comma in it breaks the cells. I can't find anyway to add an enclosing " to this to correct it.
If I instead use 'Large Table Save File' and save it as a csv file when I double click/open the document in excel. All data is in the first cell only but has proper commas and enclosed lines. I can open this properly but it requires me to open excel, a blank workbook, and then I need to import this csv file as text and set the delimiter to comma then import.
Is there anyway to save the data so when an end user just double clicks the saved file that it will open properly in excel? Normal uBot tables when saved can simply be double clicked and they load properly without any extra steps.
-
Hi.
Why do you use a browser version that is not supported with 1.3.2.6?
Please check:
https://support.bot-factory.com/knowledgebase.php?article=25
Besides that, such an error can have multiple reasons. First export the debug log to see if there are any errors. And let that guy sent this to you.
Then check if he's using an up2date windows 10 operating system in english language. Not other old stuff.
Ensure that the paths you're using to point to the portable browser are correct. Also export those variables that you use to a log file and check everything.
You have to include tracking in your bot to validate every single step. And see what happens on his PC.
Sometimes an OS installation is messed up and stuff doesn't work.
I also had a case where the installed browser had to be removed completely first. Reboot. Use Chrome cleanup tool. Reboot. Try again.
If it still doesn work, install chrome again. Reboot. Try again.
And yes, very often you're guessing. Because PC installations are so different. And it's all software, and stuff can be messed up.
But if you track the variables and everything, you have some good informations.
Cheers
Dan
The one bugger has it running now, when he flooded me with 20 emails about how it wouldn't navigate to any website at all. Even sent screen shots of how the browser didn't work and it was stuck on navigate, but now i can see it open on his system in newer screen shots! Sometimes you just get the worst crazy customers. I will try to get it out out him what he was doing. I got another 15 emails from him today alone. Kiling me.
I thought i had a compatible version. Can you make a mirror of the portable supported version? If you don't want the downloads send it to me and I will S3 it and post the link here for public use. I tried to find it but haven't had any luck. The portable apps source forge link from pages ago is not capable of downloading chrome to install it. It must no longer be on googles servers or portableapps.
-
Holy Shit! The update is crazy helpful! The ability to collapse uBot code views is insanely helpful. uBot needs to pay you for making their program so much better.
Edit: I found a error in the collapse code part. It looks like it gets confused if you have a { or } escaped in your code. Below is a example.
if($contains(#soup,"\"tripAdvisor\":\{\"Rating\":")) { then { set(#tripReviews,$plugin function("Advanced Data Text File.dll", "$regex find", #soup, "(?<=tripAdvisor\":\{\"Rating\":\"...\",\"ReviewCount\":\").*?(?=\",\")", "None", 0),"Local") } else { set(#tripReviews,$nothing,"Local") } } -
Has anyone every had a customer that could not use the EXB Navigate? I recently moved more of my scrapers to EXB from the Ubot browser and suddenly I am getting more emails for support. Main issues are
1) Exb doesn't open at all. I have included a full copy of 67.0 as a portable with the program and it is used by default. Works for me works for others but doesn't work for some.
2) Exbrowser will open but never navigate to a website, or it will navigate to 0.0.234.195 when using proxies.
I am about to just refund the one guy I have like 20 emails from him over the last few days. I have no idea and I can not find any logical reason as to why exbrowser can open for him but never actually navigate to a website. He says all firewalls/antivirus is off, home internet connection, and windows defended turned off, with proxies, without proxies.
I really just want to know a better way to tell people what to do to fix the issues. Telling them I don't know why its happening or have them do this or that with no results just makes it seem like I am guessing (which I am).
-
Has anyone run into this before? My UI that I have had since uBot 4 works in the Browser (21) in ubot 4, 5 and 6. If saved as an html file it works in Chrome/Firefox/Edge as well. But if I try to load it in CefSharp uBot 5 or 6 the program never opens. If I open an empty bot and then paste it into the uBot then parts of the UI don't work or it totally crashes.
I can't post the UI here since it is branded. But is there any known issues like maybe the html has to be 100% perfect with all <p>'s closed or something? Chrome's Inspector reports no html errors.
-
Does anyone have the source for the license dll so I can recompile to .Net 4.5? or if you have the bin already done that I can just replace?
-
This we can do easily. But I'm not so sure, if this will really help anything?
Do you have a website, where you used this and it makes a difference? Or a website, where ExBrowser is blocked somehow?
Dan
If you need a test site go to Manta.com you cant even load it in ExBrowser. I don't know if the fix works or not but its a good test site perhaps.
-
No you don't, as long as you don't update the browser.
The thing is, there are always dependencies. If you have a newer browser version, sometimes the plugin needs to be updated, because a new driver might be necessary. That's not always the case, but it can happen.
It's like when you buy a new computer, your old adapters might not work anymore. And you need new ones. Same thing here.
So now the question is what should you do. Well if you only write plugins for yourself to make your life easier.. simple. Don't update the browser and use the tested and supported version. That's it.
If you sell bots, then I highly recommend you use a portable version of chrome or firefox and ship it together with your bot. If you rely on an installed version an let your customers control the updates.. You will be screwed very often and get lot of support tickets. Because people will not listen, or have no idea how to stop updates from happening.
Hope this helps
Cheers
Dan
I am the latter in your message and I am currently flooded with support tickets lol. I tried to have users download Firefox portable in the past as a option to get past the updates but the Firefox portable still auto updated itself! How do you go about having a Chrome or Firefox portable that will not auto update while being used? Just having the thing open while scraping seems to tell it to download the update in the background without telling you.
My program only uses Open, Navigate, Click, Type Text, Get Document Text do we know if these are stable in the beta? Id love to get rid of this pile of tickets asap.
-
If you put any files in Make-Ubot-Install\Resource\Program File\ then after you install it makes a path of folders like the error other users mentioned in this topic.
So it looks like this after you install the program.
C:\Program Files (x86)\PROGAM NAME\C\Users\USERNAME\Desktop\Make-Ubot-Install\Resource\Program File\
This program would be amazing because I still use uBot 4 so having a installer would be very nice and I could include all resources.
-
How do I included license files with this installer? I need to include meter's locker license files with the program.
I tried to add them to the Program File folder that you have but when I installed the thing it recreated the entire path like people described above. So in the program folder it made a C / Program Files / Program Name folders. It did not put them in the the program folder, but inside of a full path of folders.
I just got it from your server so this is the newest version.
-
Thanks! It looks like the problem is fixed in the beta. Just ran it thought the same program and data is no longer getting mixed up.
-
Default ubot find regular expression had no problems in the same script. I have had to change to Find First Regex from another plugin and it also runs with no problem now. The error only happened in the items where i was using your regex find. Data was going all over the place and being written together despite only using local variables and set table cells for data.
Check out this csv file https://www.dropbox.com/s/tfgoc9akplufns3/homeAdvisor-Roofing-75219-20170930.csv?dl=0
Numbers from reviews are in names, phone numbers are in names as well. But this is impossible since threads only have local variables and write to set columns and row numbers specific to the thread. For example the column number is hard coded to the exact column header, row number is taken from a counter. There is no way for a phone number to be added to the name column like that.
Also the original code with the regex find worked perfectly with only one thread. As soon as it was multi-threaded the data got all mixed up. In the above csv file name to rating was regex find and had its data moved around, the other columns were ubots find regular expression and had no errors.
-
I am using advanced data text file 3.9.1.6 and I have found that when using "regex find" that the data is not tread safe. Data from one regex find is getting randomly mixed up with data from other regex finds between threads. When I stopped using your regex find all data went back to normal. Ive found the problem in uBot 4 and 5 and complied bots. Tested on Windows 10.
Can you confirm the problem or look into it?
I did a simple find and replace after updating the pulgin so my code all looks like this. I dont know if having the Index of 0 would cause problems or not that is just how it used to work.
set(#phone,$plugin function("Advanced Data Text File.dll", "$regex find", #soup, "(?<=itemprop=\"telephone\">).*?(?=</span>)", "None", 0),"Local")
[Sell] Exbrowser Now On Sale
in Plugins
Posted
I just want to say that I finally purchased EXB 2 because I wanted to support Dan as the dev. He removed the retarded callback, and ended up on damage control for days it seems. Like I said I was never against given him money but damned if he didn't go about this all the wrong way. I already purchased Aymens program so I guess I own both now. Supporting EXB ended up costing me an extra $150 for Aymens because of your nonsense during the past weeks which really sucks.