Jump to content
UBot Underground

Multithread Scrapper... Browsers In Threads Crash One After The Other...


Recommended Posts

...until there is simply not a single working browser in any thread !

 

I'm wondering what the issue is here.

 

=> Could it be that the "navigate" function with "wait" enabled would crash if somehow the page doesn't load ? (of course I've visited the suspicious pages and they seem to work fine).. I'm expecting it to timeout instead of resulting in a "forever loading browser of dead) but maybe that's the cause (?).

 

As it's a scrapper I don't see much which could go wrong, especially crash the browsers.

 

Any idea ? I'm pretty sure it's a very common problem.

 

Cheers,

Link to post
Share on other sites

Couple of ideas:

 

1. There are two browser versions within Ubot Studio. 21 and 39. Tools Options Menu. Give both a try. Sometimes one works better than the other.

2. There are definately pages where the internal Ubot Browser has some challenges. 

3. It depends a bit on how you code your'r threads. Do you open a new browser in every new thread, or do you keep the browser active within a thread?
There is a "reset browser" command. Maybe give that one a try?

 

And the Ubot Team will probably update the CefSharp browser (Version 39) very soon. The version that's currently ships with Ubot Studio is CefSharp 39.0.0.1 which seems to be 1 year old already.

 

https://github.com/cefsharp/CefSharp/releases

Shows 47.0.3 as the latest one.

Dan

Link to post
Share on other sites

Thanks Dan, I'll try this and report back.

 

I don't think my multithread is the culprit as even if I run my old (unthreaded) bot, it gets the white browser screen of death after visiting maybe 40 URLs.

 

By the way I'm using 5.9.18, I hope it's not like a couple years ago, a.k.a. current version is buggy like hell and I would need to use V4 (?)

Link to post
Share on other sites

Thanks Dan, I'll try this and report back.

 

I don't think my multithread is the culprit as even if I run my old (unthreaded) bot, it gets the white browser screen of death after visiting maybe 40 URLs.

 

By the way I'm using 5.9.18, I hope it's not like a couple years ago, a.k.a. current version is buggy like hell and I would need to use V4 (?)

 

Hard to say. 99% of the time I don't use the build in Ubot Browser anymore. :-)

 

Cheers

Dan

Link to post
Share on other sites

Update: thanks again Dan, the bloody v39 Ubot browser IS 100% the culprit... changed to v21 and it works flawlessly... 

 

Only downside of this is... can't change the Http Browser Headers with this old version.

Link to post
Share on other sites

I would bet just doing a multithread "browsing 200 sites" bot will crash with v39... and from all the reports on the forum it's not a usable version.

 

Yet I'll try to see if I can find what version of my bot had this issue, i.e. at what point I switched to v21.

Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
×
×
  • Create New...