load and scrape url contents in the background

[batibot 0]

Is it possible to load a url and then crape its contents without navigating to the actual url itself?

 

example: say in my Ubot browser, I currently have google.com but I want to scape the contents of bing.com (in the background) so I can look if a certain text that exist on bing.com (while its running in the background) that I can manipulate in my current browser which is google.com.

 

Can it be done? TIA

 

 

[Pete_UK 9]

Sure. Process would be something like ...

1) Navigate to Google

2) In a new thread Goto Bing. Scrape what you need & save in a variable / lists / table.

3) Once the thread has finished... use the data you saved to do what ever you wish on the Google page

[batibot 0]

What do you mean new thread? Add new script?

I tried that but when I'm navigating to bing.com in a new script, the current script also navigate to bing.com which I don't want to happen. 

I guess all scripts shared one browser. right?

[Pete_UK 9]

Take a look here... http://wiki.ubotstudio.com/wiki/Thread

 

Note, you need the Professional and Developer Edition to use THREADS

[UBotDev 276]

Threads will only allow you to run multiple browsers side by side, so I think you are missing the part about browsers as well.

 

As answered in the other topic you've opened, one way is to use "in new browser" command to spawn a new browser, or as an alternative you could also use "$read file" function, which reads the content of the page but doesn't render it in a browser, it just stores the HTML inside UBot variable.

[batibot 0]

too bad I don't have Pro or Dev so I don't have access to threads.

 

I tried using "in new browser" to navigate to the iframe src but it loads the site in the new script as well as in the original script basically sharing the same browsers all through out the scripts.

 

It would be good if the main script has google.com running and the other script has bing.com simultaneously running so I can scrape dynamic contents to and from. (if that all is possible).

[Pete_UK 9]

UBotDev is right. I guess with so may browser crashes I just get use to multi-threading with http and skip the browser completely.

'in new browser' will allow you to view both pages at the same time. Before the new browser closes, just save the page to a variable OR use read file (agin into a variable) as mentioned.