InfernusDoleo
-
Content Count
14 -
Joined
-
Last visited
Posts posted by InfernusDoleo
-
-
Scratch that - I dont appear to have any open. But - its telling me I do. Is there a way to fix that? If I save it and re-open it will I lose changes?
-
Often when editing, I'll edit a few nodes to see their exact contents, but forget to close them. Then, I try to run my script and it won't - nodes are still being edited. But I've no idea where without expanding the node window and scrolling through the whole thing.
Is there a way to finish editing/close all open nodes at once?
-
Awesome, thank you.
Edit: Nevermind, ctrl-space is worthless. See my post below.
-
Yeah I guess I'll have to go that route. It does appear that wait for element is waiting for the entire page to load before checking. Making my own check loop will avoid that. Thanks.
-
I cannot find this anywhere - is there a hotkey to edit a node? I often need to make changes, yet, I have to right click the node, then hit Edit - major hassle for someone who's faster with a keyboard than he is switching back and forth to a mouse.
I bought Ubot studio years ago when 4.2.something was the current release, and just yesterday re-subscribed and upgraded. Not having used it for years I'm totally rusty on the command syntax, so I'm using the nodes for now. The right click to edit is killing me. Any solutions?
-
Quick question regarding wait for element. I'm doing some scripting on a webpage which, after the page loads, some javascript fires off that loads some additional information. Basically - the page loads, then after the page (and the elements I need are available) is loaded, some ajax calls are made that, using your IP address, loads some extra data to the page.
I do not need to wait for all the extra ajax calls to run for me to act on the page, yet, even though I am using 'wait for element' to wait for the page to load the button I need, the script is not continuing until all of the extra javascript/ajax elements are loaded. Does wait for element not proceed until the page is completely loaded? I'm not doing a navigate which requires the page to load - I'm clicking a button, which then loads a new page. I can proceed before the rest is loaded, as long as the next button is there. However, wait for element seems to sit and wait for all ajax calls to complete before continuing.
Is that normal? And if so, can someone suggest a workaround? I'm running my script through a TOR socks proxy, which slows the whole process down considerably. The loop of my script, since it's running through tor, is delayed by about 3-4 seconds per loop because of the waiting to load. I've tried to find where the calls are being made to block the javascript from running, but the page is extremely complex and it would take a long while to find the code.
Is there another option? If I don't wait, since it's through tor, the script runs before the page is fully loaded. But I dont want to wait for it to load completely before continuing. Suggestions?
The page in question is lowes.com - I'm scraping product data. After the page loads, it then uses your IP or zipcode to show you your local store. If you load it through a slow connection (TOR), you can see at the top, 'Welcome to Lowes, Find a Store', then a few seconds later as the page continues to load, it changes to "Open until 10PM! <your town> Lowe's" I don't need to wait for that to proceed, yet, wait for element is not continuing until that is finished loading.
-
Nevermind. Found it. Scrape the URLs. Man, its been a while.
-
I'd like to write a script that will go to ebay, run a search, and then click on (and pull info from) each item that shows on the search page.
I havent used ubot in about 2 years (bought it back then, just upgraded it today) so I'm getting back into the swing of things. I had some compliacted scripts for user account generation, however, I've never had to take a "random" list of URLs on a page and manipulate them.
Anyone know of a starting point, or a command to use to get a list of the links? Or a way to accurately step through them?
Once the link is clicked, I can manage the rest - thats easy. Pulling data from the page, clicking links in there, etc. No big deal. It's just the "click this link, then do some stuff, then go back and click the next link, loop" thats got me confused. Thanks!
-
Did you retry Navigating to the same link?
Unless I'm misunderstanding you - yes.
Here's what I'm doing... I have a script that fires off and pulls up a webpage, and it navigates to the account sign up page.
It then opens a subwindow to MY page that provides the account info (I dont use the internal account info as I need a REAL shipping address - I have a script that scrapes those from real estate websites). It scrapes the data, and pastes it into the account page and submits it. All works fine.
When I press play to run the script again, the sub window opens with the same data in it, like it was showing the cached version, and not re-loading the window.
So I tried a location.reload() javascript line in the "in sub window" section, but it refreshed the MAIN window, not the sub.
I could make a reload button on the subwindow page and press that, but that seems to be... a bandaid for a problem in UBot...
-
I'm loading a sub window to pull data from my own web site (it pulls data from a database then puts it in a form so I can scrape the data).
However, every time I run the script, the sub window doesnt refresh, it just shows what it loaded the first time.
When I try to javascript a location.reload() it's refreshing the MAIN window, not the sub window.
How can I force that sub window to reload every time it's called?
-
Choose by see attached.
Far as 3 if you are moderate or higher with php / mysql you will understand POST and GET and how it works.
example having your bot navigate to a site url as
http://yoursite.com?useremail=something&somethign=somethinganswer
in your site you can have the php for example
<?php if( isset($_POST['useremail']) && ($_POST['useremail'] != '')){ //process something in mysql here with mysql_query } ?>Riiiight... I know choose by. Got that. I said I cannot find SCRAPE CHOSEN ATTRIBUTE anywhere in the Set paramaters...
And as for the PHP scripts, I already said in the OP that I've already DONE that. I was wondering if there was a way uBot interfaced directly with MySQL.
-
1. choose by attribute, use the set node and content use scrape chosen.
2. use threading with new window or just new window depending on your application needs.
3. yes you can interact with mysql however you ahve to send the php pages details and then have your php page use $_POST or $_GET the attributes and use it accordingly with the database.
Tabs
at the top of the ubot development area hit the new tab button. next to the name of your tab at the top.
TJ
Where do I find scrape chosen? I dont see that anywhere in the set Paramaters...
As for #3 I've absolutely no idea what you're talking about.
-
So, first, my apologies for posting something I SHOULD be able to find elsewhere. But 20 minutes of google and forum searching has come up with nothing, so here it is...
First: How do I take text from a text field form, and copy it to a variable? I've looked and looked, and I cant find anything to do it...
Second: I've used iMmacros before, and you can open multiple tabs (not for bots, but browser windows) and switch between. I have NOT searched on how to do this yet, figured I'd ask as long as I'm posting.
Third: Maybe there's a better solution, so here's what I'm doing and maybe I can do it in a more streamlined manner. I'm taking data from a database, submitting it to a web form, and then taking results and posting it back into the database. I used to do this via CURL/PHP scripts, but by doing that I need to examine the source of the page loads, and manually build everything. Its why I bought UBot, it's SO much easier.
In PHP I can directly interface with the MySQL database. So my first question - can UBot do that? I'm assuming not, it's not something most people would need.
So failing that, I've made webpages to pull and insert data from the database. It's how I messed with it using iMacros. No big deal. I've actually made the beginnings of a bot that pulls up my page, inputs some data, submits the form... but now I'm where I need to pull the data thats returned back into UBot - hence question #1 above.
Is there an easier way to interface with my database? I dont mind the setup I'm using. If I could have tabs that would make things easier (tab1 is the website I'm working on, tab2 is my website for data pull/push).
Failing all that - how do I take text from a form field and copy it into a variable?
Hotkey To Edit A Node?
in Scripting
Posted
Even worse, is often when I use ctrl-space to edit a node, it glitches and does not work correctly.
Example - here is a node, unedited:
Here is a node if I right click and edit it:
And heres what happens sometimes when I select the node, and hit ctrl-space to edit it:
Yep - its in "edit" mode as seen by Ok and Cancel - but I can't exactly EDIT it if the box does not expand.
I hope to one day soon get back to fluency and just coding in the code window, but for now I need to use the nodes to refresh myself, and having to grab the mouse to right click when I need to make a change is making me lose hair.
Side note: Editing a node, scrolling away, editing another node, closing it, then trying to run, and being told I need to finish editing the OTHER NODE first? Screw that. I've literally spent 15 minutes scrolling back and forth trying to find an open node somewhere and not being able to find it. I've paid HUNDREDS of dollars for this software. Why the hell are there not the simplest of features? Close all open nodes button, PLEASE.