-
Content Count
464 -
Joined
-
Last visited
-
Days Won
26
Posts posted by PRO
-
-
Original download URL is not working anymore.
For everyone wondering, have attached the plugin download to this message*
*you need to be logged into an active forum user account in order to access and download the file.
-
Hello @cdarrell, are you trying to automatically login to a self-hosted WordPress site or one that is hosted with wordpress.com ?
Are you sure this issue is related to the browser?
A 401 Error typically means that the webpage you're trying to access requires a valid user ID and password.
Logging into WordPress CMS should not be an issue as of my knowledge.
Did you double-check that there is no other possible root of the problem?
-
Hello @Urgent Enquirer, I assume your question was much to specific with all your requirements.
Many people have found ways to make money using UBot. But you asked a very very specific question, right?
I would suggest, explore the forum or read the following threads.
Maybe some of the members there might even reply you if you ask something related that's easy enough for someone to answer:
-
Really sorry that I can't test your code atm. But I can suggest to put a "stop script" after questionable steps, then hitting run and looking inside the debugger if everything looks good until the step before the "stop script".
Then move the stop script one command down the line, run again and check the debugger again.
Repeating this should enable you to identify the exact step where the issue starts to appear.
-
Ok, try putting "wait" or "wait for element" after this line:
plugin command("ExBrowser.dll", "ExBrowser Navigate", $table cell(&LinkedIn Data,#row,8))
It's similar scenario. Right after the navigate command.
-
You tried my suggestion already?
-
Hello @cjacobs, I removed your ExBrowser license key from within your code 😉
Without having tried yet, I assume you want to try putting a wait right after:
plugin command("ExBrowser.dll", "ExBrowser Navigate", "https://www.linkedin.com/")
I assume that the content you try to scrape loads asynchronous.
So try to make sure it‘s really loaded before continuing (e.g. putting a simple "wait" or a "wait for element").
-
Your selectors are not correct. See my answer here:
-
@Urgent Enquirer, glad you found it working just fine 👍
You ask: "How come on my end, the google search result link attributes are shown as XY while on your end AB?"
This is because of skill. For me it looks the same and it doesn't just "show". Needs your own skill to figure out the correct selectors.
And because the search result page is difficult to figure out, I put this example code to make it easy, showing you a ready-made solution.
Please understand that I won't explain every line of code one by one.
-
Try this:
type text(<name="q">,"\{ENTER\}","Standard")
Feel free leaving a like if this solved your problem.
-
I tested your code. And no, there is no bug. You only confused how to use the "add list to list" command here.
This:
add list to list($scrape attribute(<outerhtml=w"<span>*</span>">,"innertext"),%keywords,"Delete","Global")
Should be this:
add list to list(%keywords,$scrape attribute(<outerhtml=w"<span>*</span>">,"innertext"),"Delete","Global")
-
If you prefer using ExBrowser, you can use the following XPath expression instead in order to extract the organic results:
x://div[contains(@class,"yuRUbf")]/a[1]
Use the XPath expression inside a "scrape list element attribute" function and set the attribute to be "href".
Congratulations 🤖
-
@Urgent Enquirer, regarding your Google search results question, here is the answer:
-
-
Hello community,
Because many people have asked for help regarding this, here is some ready-made UBot code for you.
This example code works with UBot Studio only (without the need for any plugins being installed). For more demanding scenarios there are other, more sophisticated ways to achieve things by utilizing additional plugins for UBot Studio.
Feel free to leave a like if this helped you out.
Last updated 2021-09-06 13:55 CET
navigate("https://www.google.com","Wait")
wait(2)
comment("Click Google Privacy Consent Button if present")
click(<class="tHlp8d">,"Left Click","No")
wait(1)
comment("Do Search")
navigate("https://www.google.com","Wait")
wait(1)
change attribute(<name="q">,"value","weather")
type text(<name="q">,"\{ENTER\}","Standard")
comment("Wait for Results Page to Load")
wait for element(<id="result-stats">,"","Appear")
wait(1)
comment("Extract Organic Results HTML elements")
set(#scrape_organic_results_html,$scrape attribute(<(tagname="div" AND class="yuRUbf")>,"innerhtml"),"Global")
comment("Filter Organic Results HTML elements")
set(#scrape_organic_results_html,$find regular expression(#scrape_organic_results_html,"<a href=\".*?\\\""),"Global")
set(#scrape_organic_results_html,$replace(#scrape_organic_results_html,"<a href=\"#\"",""),"Global")
set(#scrape_organic_results_html,$replace(#scrape_organic_results_html,"<a href=\"",""),"Global")
set(#scrape_organic_results_html,$replace(#scrape_organic_results_html,"\"",""),"Global")
comment("Put extracted Links into List")
clear list(%organic_results_href)
add list to list(%organic_results_href,$list from text(#scrape_organic_results_html,$new line),"Don\'t Delete","Global")
comment("Output Results")
alert("You scraped {$list total(%organic_results_href)} organic results!
{%organic_results_href}")- 1
- 1
-
@Urgent Enquirer, Yes, I know they make it not exactly easy to figure out. On the SERPs especially, they use the same classes a lot for the DOM elements and other things that make it hard selecting and interacting with desired elements.
I did this for a rather educational purpose a few months back. Needs me more time to read through my previous code (have a lot in hundreds of files). Another user also asked this.
As soon I have time to investigate my old code or do a new one, I let you know. Till then I can only say, it should be possible with some advanced XPath (combination of selectors).
- 1
-
@Urgent Enquirer, welcome. I would say always write the simplest and shortest code that works for you.
I did no check to keep things as simple as possible. If no check needed, don't check.
This is how a Google Privacy Consent Page looks like:
- 1
-
I know it's not 80s, just found the performance worth sharing here, special thing...
Have a nice day. Giorgia Angiuli - Live Set for Awesome Soundwave & Beatport.
-
Hello @Urgent Enquirer, this is how you can handle G Search with UBot natively (without plugins):navigate("https://www.google.com","Wait")
wait(3)
comment("Click Google Consent Button if present")
click(<class="tHlp8d">,"Left Click","No")
wait(1)
navigate("https://www.google.com","Wait")
change attribute(<name="q">,"value","weather")
type text(<name="q">,"\{ENTER\}","Standard")Feel free to leave a like if this helped you further.- 1
-
@Bliss, seems like "you have been one with the bliss" 😁
Really amazing story and thanks for your best wishes.
Have sent you a PM.
-
Haha. Regarding 3.) I once had a python developer begging me to code it in UBot instead (really) 😂
He was like "please you develop this instead of me, using your UBot Studio thing. Otherwise I would need to spend countless sleepless nights, weekends etc. in order to achieve the results. 🤠
And I know that for you, using UBot, you can code it all up in one afternoon session"(he was noticably slow in progressing with his approach and he experienced bugs and challenges already without being near to finish important modules of a first prototype. He was already sitting with it for ages, being unable to make all the different tasks being executed in one bit complex workflow of different single tasks)
The other dev was a proud guy. For him it was a big thing admitting that UBot is the superior approach in the given scenario. I realized that this is a reality, rarely someone talks about when comparing UBot (with the best plugins) with the alternatives.
Typically the first impression of UBot makes many "traditional" developers look down at it. They assume it must be rather a toy for beginners than a incredible useful tool to achieve results with.
It happened for me now multiple times that people changed their opinions after seeing the results I was able to achieve with it in real world scenarios (fast development, versatile, automating various workflows, run 24/7 on remote server, syncing data from A to B, connect to various other web systems, handling repetitive tasks at scale, getting things automated).
Also found Full Stack Web Developers can benefit greatly when working together with an UBot expert. Often times they need some quick mass task automation in their processees to speed up a bigger web development project (for example computational heavy tasks and bulk tasks to fill up their database or built a custom API for something that dosn't exist yet or to replace or extend exisitng interfaces).
We could possibly make some time to release sample UBot code, improving on the written documentation, creating tutorial videos, releasing ready made code with examples on more advacned challenges that many of us may face (e.g. how to make bots run 24/7 on remote server, syncing data from A to B etc.). But this would require significant extra effort from our side, as we would also need to care about producing more advanced documentation and educational resources.
This is only possible to the degree in which the yearly subscriptions are able to cover for the basic costs for all of this being done.
-
Thank you, @Bliss. Totally agree on point 1 and 2.
1. yes
2. yes (up to 10 in a bundle, this is a restriction from our licensing system. There will be an option to get all, even if it will consist of 2 or 3 bundles.)
3. UBot still holds on to me. Love it so much and appreciate the usefulness of it, so that I even took on the extra effort securing and prolonging Pash's legacy plugins, putting small team of Automaxed in place, already working on improving on things, making things ready for the future.
I never saw another convincing alternative to UBot Studio (plus plugins). In terms of usefulness, development speed, swift automation of workflows, affordability, flexibility to achieve custom results fast - UBot still is a "precious gem" for me.
Would love to see the next generation of developers coming into UBot Studio. This is why we at Automaxed are thinking about to lower the entry barrier for young professionals, educational, voluntary or scientific users.
Basically reducing the price for groups and individuals that haven't made enough money by coding (or learning to code) yet.
Maybe it is similar for some of you. Just don't want to miss any of it in the future.
Thanks for your valuable feedback.
-
Hello @cob007, thanks for your suggestion.
Following your advice we would rather have no apple devices at all anymore (because without Steve Jobs?)? 🙃
This approach will not work for us, I am sorry. It would not benefit the community.
I understand your point and take your feeback in consideration (valuing legacy customers).
Thanks for expressing your gratitude towards Pash, he has done an incredible work indeed.
-
55 minutes ago, Chainsaw said:
Thought I'd try installing the latest Ubot. Trying to run it requires .Net Framework 4.8 which unfortunately isn't supported on Win 7.
Can recommend the 5.9.55 version. You can download here https://s3-us-west-2.amazonaws.com/ubotsupportfiles/5.9.55+Setup.msi
Tested on Windows 7 SP1, .NET 4.8 - all works great. (image attached)
I also ran the latest version of UBot on that same windows 7 machine recently.
Did you try this already?
It should work. Good luck.
Most Stable Version
in General Discussion
Posted
You can download here: https://s3-us-west-2.amazonaws.com/ubotsupportfiles/5.9.55+Setup.msi