Jump to content



Photo

Ubot doesn't show www.tumblr/search results anymore ?

tumblr browser

  • Please log in to reply
24 replies to this topic

#1 zenos

zenos

    Advanced Member

  • Members
  • PipPipPip
  • 286 posts
  • LocationFrance
  • OS:Windows 7
  • Total Memory:More Than 9Gb
  • Framework:v4.0
  • License:Developer Edition

Posted 06 November 2014 - 09:19 AM

Since the last update of tumblr, I cannot show the result of a research on tumblr.

 

I've tried many user agents as possible, the result of a search doesn't appear anymore.... Look at my screen.

 

Do you have guys a solution for this ? Any idea of what could be the problem ?

 

The source code from the search page (on ubot) is not the same as if I open it with firefox, miss a lot of things.

 

I use ubot 4.2.20, I also have tested it on Ubot 5.0

 

 

Attached Files



#2 giganut

giganut

    softwareautomation.org

  • Fellow UBotter
  • PipPipPip
  • 535 posts
  • LocationLost In Space!
  • OS:Windows 10
  • Total Memory:4Gb
  • Framework:v4.5+, unsure
  • License:Developer Edition

Posted 06 November 2014 - 09:23 AM

Yes it seems that some sites are identifying the ubot browser due to the lake of spoofing tools in ubot and the outdated awesomium
 browser bolt on. I have been having this problem for a few weeks, I will PM you the work around. But this needs to get fixed by the

developers. the outdated awesomium browers is becoming a big problem.


softwareautomation-banner.png


#3 zenos

zenos

    Advanced Member

  • Members
  • PipPipPip
  • 286 posts
  • LocationFrance
  • OS:Windows 7
  • Total Memory:More Than 9Gb
  • Framework:v4.0
  • License:Developer Edition

Posted 06 November 2014 - 10:36 AM

Yes it seems that some sites are identifying the ubot browser due to the lake of spoofing tools in ubot and the outdated awesomium
 browser bolt on. I have been having this problem for a few weeks, I will PM you the work around. But this needs to get fixed by the

developers. the outdated awesomium browers is becoming a big problem.

 

Thank you very much for your answer ;)

I'm waiting for your PM, thank you again you rock !



#4 malefic

malefic

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 569 posts
  • OS:Windows 8
  • Total Memory:3Gb
  • Framework:v3.5 & v4.0
  • License:Developer Edition

Posted 06 November 2014 - 10:54 AM

Heard a few people saying this but touch wood I haven't had the problem yet and my Tumblr bots are working okay (apart from the like bot, having problems with that one but not in the searching).

 

Agree that Ubot needs to sort this out as its down to what the others have said as well as browser size spoofing - if you open in a new browser the default window size is 500x500 which makes it stick out like a sore thumb.



#5 giganut

giganut

    softwareautomation.org

  • Fellow UBotter
  • PipPipPip
  • 535 posts
  • LocationLost In Space!
  • OS:Windows 10
  • Total Memory:4Gb
  • Framework:v4.5+, unsure
  • License:Developer Edition

Posted 06 November 2014 - 01:02 PM

Heard a few people saying this but touch wood I haven't had the problem yet and my Tumblr bots are working okay (apart from the like bot, having problems with that one but not in the searching).

 

Agree that Ubot needs to sort this out as its down to what the others have said as well as browser size spoofing - if you open in a new browser the default window size is 500x500 which makes it stick out like a sore thumb.

 

You may want too keep an eye out for the change to your accounts. Twitter tried this trick a while back where they only changed some people accounts and then left the other account original. I ended up have to build two bots in one so it worked on everyone's account


softwareautomation-banner.png


#6 Edward_2

Edward_2

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 521 posts
  • LocationCanada, BC
  • OS:Windows 98
  • Total Memory:8Gb
  • Framework:v3.5 & v4.0
  • License:Developer Edition

Posted 06 November 2014 - 07:19 PM

This may help

 

Some info

 

https://www.tumblr.com/docs/en/api/v2

 

Test You'll need to use some regex to parse it.

 

http://api.tumblr.co...h10LXZhhRKjWlV4

 

Peace


sig-big3.jpg


#7 Chris M

Chris M

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 497 posts
  • OS:Windows 10
  • Total Memory:More Than 9Gb
  • Framework:v4.5+, unsure
  • License:Developer Edition

Posted 06 November 2014 - 09:18 PM

Why haven't they updated that yet? Have they even explained why they're not upgrading it?



#8 zenos

zenos

    Advanced Member

  • Members
  • PipPipPip
  • 286 posts
  • LocationFrance
  • OS:Windows 7
  • Total Memory:More Than 9Gb
  • Framework:v4.0
  • License:Developer Edition

Posted 07 November 2014 - 05:39 AM

Thank you guys for your answers. I'm don't want to use the tumblr API to let tumblr think the actions I make with my bot are done by an human.

I dont' understant why ubot browser cannot show the entire page of the tumblr search page, some of the scripts are not loading, some buttons and images are not loading and it sucks...

 

I really hope Ubot team will upgrade Ubot 4 awesomium to make it work again :(



#9 malefic

malefic

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 569 posts
  • OS:Windows 8
  • Total Memory:3Gb
  • Framework:v3.5 & v4.0
  • License:Developer Edition

Posted 07 November 2014 - 05:45 AM

Thank you guys for your answers. I'm don't want to use the tumblr API to let tumblr think the actions I make with my bot are done by an human.

I dont' understant why ubot browser cannot show the entire page of the tumblr search page, some of the scripts are not loading, some buttons and images are not loading and it sucks...

 

I really hope Ubot team will upgrade Ubot 4 awesomium to make it work again :(

 

Ubot 4 is no longer supported so don't hold out for updates to Awesomium, or anything else for that matter, in V4



#10 zenos

zenos

    Advanced Member

  • Members
  • PipPipPip
  • 286 posts
  • LocationFrance
  • OS:Windows 7
  • Total Memory:More Than 9Gb
  • Framework:v4.0
  • License:Developer Edition

Posted 07 November 2014 - 05:57 AM

Ubot 4 is no longer supported so don't hold out for updates to Awesomium, or anything else for that matter, in V4

This is not cool, Ubot 5 is not working for me, cannot import some huge bots I've made with Ubot4 in Ubot 5... too bad...

I also have tested to display the "www.tumblr.com/search/keyword" URL on ubot 5.... doesn't either work



#11 arunner26

arunner26

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 292 posts
  • LocationBradenton, FL
  • OS:Windows 7
  • Total Memory:8Gb
  • Framework:v4.0
  • License:Developer Edition

Posted 07 November 2014 - 06:27 AM

zenos,

I would open tickets with UBOT support on both issues since I really think they want to make version 5.5 a success.


Andy (Arunner26)

 

 


#12 zenos

zenos

    Advanced Member

  • Members
  • PipPipPip
  • 286 posts
  • LocationFrance
  • OS:Windows 7
  • Total Memory:More Than 9Gb
  • Framework:v4.0
  • License:Developer Edition

Posted 07 November 2014 - 07:37 AM

zenos,

I would open tickets with UBOT support on both issues since I really think they want to make version 5.5 a success.

 

I will try to ask the support team, but I don't understand where and how to do that...



#13 giganut

giganut

    softwareautomation.org

  • Fellow UBotter
  • PipPipPip
  • 535 posts
  • LocationLost In Space!
  • OS:Windows 10
  • Total Memory:4Gb
  • Framework:v4.5+, unsure
  • License:Developer Edition

Posted 07 November 2014 - 07:47 AM

Ubot 4 is no longer supported so don't hold out for updates to Awesomium, or anything else for that matter, in V4

 

unfortunately ubot v 5 uses the same awesomium version as ubot v 4, so where still in the same boat.


softwareautomation-banner.png


#14 arunner26

arunner26

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 292 posts
  • LocationBradenton, FL
  • OS:Windows 7
  • Total Memory:8Gb
  • Framework:v4.0
  • License:Developer Edition

Posted 07 November 2014 - 08:02 AM

I will try to ask the support team, but I don't understand where and how to do that...

http://support.ubotstudio.com/


Andy (Arunner26)

 

 


#15 UBotDev

UBotDev

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 1395 posts
  • OS:Windows 10
  • Total Memory:More Than 9Gb
  • Framework:v3.5 & v4.0
  • License:Developer Edition

Posted 07 November 2014 - 10:41 PM

I think you got this wrong...data is still served by the Tumblr server (you can check that by taking page HTML source from UBot and pasting it into WYSIWYG editor), I think it's just not rendered (correctly) in UBot, that's why you don't see the results.

 

With that said, you are still able to scrape the URLs,example:

add list to list(%URLs, $scrape attribute(<data-pin-url=w"*">, "data-pin-url"), "Delete", "Global")

Even clicking works:

click($element offset(<class="tumblelog_info">, 0), "Left Click", "Yes")


CLICK UBotDev.com - Download FREE UBot Plugins!

______________________________________________

 


#16 zenos

zenos

    Advanced Member

  • Members
  • PipPipPip
  • 286 posts
  • LocationFrance
  • OS:Windows 7
  • Total Memory:More Than 9Gb
  • Framework:v4.0
  • License:Developer Edition

Posted 08 November 2014 - 03:59 AM

Thank you UBotDev for your answer ;)

 

 

I think you got this wrong...data is still served by the Tumblr server (you can check that by taking page HTML source from UBot and pasting it into WYSIWYG editor), I think it's just not rendered (correctly) in UBot, that's why you don't see the results.

 

With that said, you are still able to scrape the URLs,example:

add list to list(%URLs, $scrape attribute(<data-pin-url=w"*">, "data-pin-url"), "Delete", "Global")

 

Ok you're rigth with this, but I can't load more than 20 results, it does not load more posts if I scroll down...

 

And I cannot click, it does not validate if I click on a "like button".

It seems to be, but it's not clicking...

 

So why can't we see it "correctly" in Ubot ? Is it about awesomium outdated version ? What could it be if it's not awesomium ?



#17 UBotDev

UBotDev

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 1395 posts
  • OS:Windows 10
  • Total Memory:More Than 9Gb
  • Framework:v3.5 & v4.0
  • License:Developer Edition

Posted 08 November 2014 - 05:29 AM

Thank you UBotDev for your answer ;)

 

 

Ok you're rigth with this, but I can't load more than 20 results, it does not load more posts if I scroll down...

 

And I cannot click, it does not validate if I click on a "like button".

It seems to be, but it's not clicking...

owever

So why can't we see it "correctly" in Ubot ? Is it about awesomium outdated version ? What could it be if it's not awesomium ?

 

It may be that because content is not rendered correctly that UBot miss-clicks that button which may not trigger script behind it, not sure, but as you can see the click command from previous reply works.

 

I think it's Awesomiums fault, although I haven't investigated why this would happen...


CLICK UBotDev.com - Download FREE UBot Plugins!

______________________________________________

 


#18 Chris M

Chris M

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 497 posts
  • OS:Windows 10
  • Total Memory:More Than 9Gb
  • Framework:v4.5+, unsure
  • License:Developer Edition

Posted 08 November 2014 - 06:25 PM

You can change the browser size by doing something like this:

clear list(%width)
clear list(%height)
add list to list(%width, $list from text("1680
1600
2559
2600
2200
2400", $new line), "Delete", "Global")
add list to list(%height, $list from text("950
800
1265
1300
1400
1500", $new line), "Delete", "Global")
wait(1)
set(#width, $random list item(%width), "Global")
wait(1)
set(#height, $random list item(%height), "Global")
wait(1)
plugin command("SoftwareWindows.dll", "browser size", #width, #height)
wait(1)
navigate("http://whatsmy.browsersize.com/", "Wait")


#19 malefic

malefic

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 569 posts
  • OS:Windows 8
  • Total Memory:3Gb
  • Framework:v3.5 & v4.0
  • License:Developer Edition

Posted 09 November 2014 - 01:45 AM

 

You can change the browser size by doing something like this:

clear list(%width)
clear list(%height)
add list to list(%width, $list from text("1680
1600
2559
2600
2200
2400", $new line), "Delete", "Global")
add list to list(%height, $list from text("950
800
1265
1300
1400
1500", $new line), "Delete", "Global")
wait(1)
set(#width, $random list item(%width), "Global")
wait(1)
set(#height, $random list item(%height), "Global")
wait(1)
plugin command("SoftwareWindows.dll", "browser size", #width, #height)
wait(1)
navigate("http://whatsmy.browsersize.com/", "Wait")

 

What plugin is that from - I was after native support like it was in earlier versions of Ubot. It was taken out due to a problem with Awesomium and even though Awesomium has now been updated, Ubot hasn't upgraded so the problem is still there. 

 

If the plugin isn't too expensive I will have a look at getting it - just grinds a bit that I buy plugins and then months later the exact functionality is included in Ubot (look at some of the plugins released in the past - Aymenss HTTP, the FTP plugin etc - all great plugins that I had no problem buying just so Ubot can include them natively later on and call them new features!)



#20 zenos

zenos

    Advanced Member

  • Members
  • PipPipPip
  • 286 posts
  • LocationFrance
  • OS:Windows 7
  • Total Memory:More Than 9Gb
  • Framework:v4.0
  • License:Developer Edition

Posted 09 November 2014 - 04:17 AM

I found this about the browser size, http://ubotfunction....owser_size.html, but I can't add it to the cart...

I don't know who is selling it.







Also tagged with one or more of these keywords: tumblr, browser

0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users