Jump to content
UBot Underground

[SELL] Google Competition Checker - Source Or Compiled - Datagrid/HTTP Post!


Recommended Posts

Source code version is sold out!

 

Because of the system I use though I need to keep it in there for updating purposes so I set the price at $997. If somebody is willing to pay that much then they deserve to have it (I doubt that will happen though ;))

Link to post
Share on other sites
  • 3 weeks later...

Hi Nick,

Did you notice that no youtube videos show in the bot results even if they exist in the actual search results? Believe this has something to do with using the post plugin, been testing it on other bots and no matter how I try, no youtube results show in the results if you use the plugin. If you scrape the old school way, they show fine. 

 

I have an app that needs the youbtube results, but would like to use the post plugin for the speed. Any thoughts?

 

Thanks!

Link to post
Share on other sites

Hi Nick,

Did you notice that no youtube videos show in the bot results even if they exist in the actual search results? Believe this has something to do with using the post plugin, been testing it on other bots and no matter how I try, no youtube results show in the results if you use the plugin. If you scrape the old school way, they show fine. 

 

I have an app that needs the youbtube results, but would like to use the post plugin for the speed. Any thoughts?

 

Thanks!

 

Use Ubot V4. Http plugin doesn't work correctly with V5 yet.

 

Dan

Link to post
Share on other sites

Hi Nick,

Did you notice that no youtube videos show in the bot results even if they exist in the actual search results? Believe this has something to do with using the post plugin, been testing it on other bots and no matter how I try, no youtube results show in the results if you use the plugin. If you scrape the old school way, they show fine. 

 

I have an app that needs the youbtube results, but would like to use the post plugin for the speed. Any thoughts?

 

Thanks!

 

Any thoughts on this Nick? Believe it's a http post plugin issue, but not sure if it's just me or if anyone else is running into this issue?

 

Can anyone else that has this try a search that normally has youtube videos on the first page and see if the youtube videos show in the results?

 

Appreciate any feedback! :)

Link to post
Share on other sites

Any thoughts on this Nick? Believe it's a http post plugin issue, but not sure if it's just me or if anyone else is running into this issue?

 

Can anyone else that has this try a search that normally has youtube videos on the first page and see if the youtube videos show in the results?

 

Appreciate any feedback! :)

 

It could be the way the bot selects the results. It tries to filter out results like images or shopping - basically useless results that don't matter and should not come up in a tool like this. Maybe Youtube videos don't match the xpath so I'll have to check it!

Link to post
Share on other sites

Thanks Nick, appreciate that. Don't think it's the xpath though, I may be wrong, but checked the complete result of a basic google search.... google.com/search?q=keyword using http get, and reviewed the whole page source and it's the same exact result as in a browser, except for the youtube video listings.

Link to post
Share on other sites

Thanks for the update Nick, you were right, it was the xpath!

Videos showing fine here, and a quick note, don't use user agents! They don't seem to show any youtube results in google if you use a user agent the the http post plugin. Tried a bunch of different ones Aymen suggested, and they only work sometimes, never could get a consistent result. If anyone else has any experience with this let me know. Thanks again!

Link to post
Share on other sites
  • 6 months later...

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
×
×
  • Create New...