Jump to content
UBot Underground

ilovepizza

Fellow UBotter
  • Content Count

    21
  • Joined

  • Last visited

Posts posted by ilovepizza

  1. Hi all,

     

    I dont want to report a bug yet because it may be just me... but when I navigate to ipleak.net with the built in browser I can see my true IP under the webrtc results (and the proxy IP in the remaining results).

     

    I am using:

    UBot Dev Edition 5.9.43

    Built in Chrome 49

    With elite private proxies

     

    (Naturally, with a Firefox browser that has webrtc disabled the same test is negative)

     

    Anyone else seeing this?

     

    BW, J

  2. Thank you guys for the suggestions. I was using private proxies and even tried without any proxy. The site wasnt blocking / refusing requests when I navigated straight to it without http get. Since I am new to socks I was wondering if the site could potentially block requests when no browser is used. Could that be the case - theoretically? 

  3. Or you could do it this way...

     

    clear cookies
    clear all data
    navigate("http://www.tripadvisor.ca/Restaurants-g155032-Montreal_Quebec.html","Wait")
    wait(1)
    add list to list(%company name,$scrape attribute(<class="property_title ">,"innertext"),"Delete","Global")
    add list to table as column(&restaurant,0,0,%company name)
    add list to list(%company url,$scrape attribute(<class="property_title ">,"fullhref"),"Delete","Global")
    set(#RowCounter,0,"Global")
    loop($list total(%company url)) {
        navigate($next list item(%company url),"Wait")
        wait(1)
        add list to list(%reviews,$scrape attribute(<property="v:count">,"innertext"),"Delete","Global")
        add list to table as column(&restaurant,0,1,%reviews)
        add list to table as row(&restaurant,#RowCounter,2,$scrape attribute(<class="valueCount fr part">,"innertext"))
        increment(#RowCounter)
    }

     

    (I guess this is what you were after)

    • Like 1
  4. Hi guys,


     


    I am just starting out with the http post plugin and have tried to find the answer for the following question on the forum but no luck. I am on Ubot 5.5 revision 13.


     


    Can you let me know why I get a 403 error if I try "http get" from this site: http://myip.is/ while it works perfectly fine with google?


     


    This works with google:


    ui text box("Keyword:",#Keyword)


    set(#google_results,$plugin function("HTTP post.dll""$http get""https://www.google.com/search?q={#Keyword}"$plugin function("HTTP post.dll""$http useragent string""Firefox 27.0 Win7 64-bit"), ""#Proxy""),"Global")


     


    But not with myip.is (403)


    set(#myipis,$plugin function("HTTP post.dll""$http get""http://myip.is/"$plugin function("HTTP post.dll""$http useragent string""IE 11.0 Win7 64-bit"), " "#Proxy, 5),"Global")


     


    Sorry I guess this is a noob question...


     


    Can anyone confirm you get the same error scraping myip.is with http get using Ubot 5.5 rev 13?


     


    PS: The proxy is working of course - the error is the same with or without the proxy


  5. I was using the Aymens plugin instead of the socket container because I would like to use proxies. 

     

    Oddly enough the socket navigate get (your code above) does not return any content - even though I was using this successfully before. I am beginning to think there might be an issue with my setup. All I did lately was updating to revision 13 and installing Aymens plugin. 

     

    Can anyone verify Aymens HTTP Get works just fine with myip.is? 

  6. Hi guys,

     

    I am just starting out with the http post plugin and have tried to find the answer for the following question on the forum but no luck.

     

    Can you let me know why I get a 403 error if I try "http get" from this site: http://myip.is/

     

    This works with google:

    ui text box("Keyword:",#Keyword)

    set(#google_results,$plugin function("HTTP post.dll""$http get""https://www.google.com/search?q={#Keyword}"$plugin function("HTTP post.dll""$http useragent string""Firefox 27.0 Win7 64-bit"), ""#Proxy""),"Global")

     

    But not with myip.is (403)

    set(#myipis,$plugin function("HTTP post.dll""$http get""http://myip.is/"$plugin function("HTTP post.dll""$http useragent string""IE 11.0 Win7 64-bit"), " "#Proxy, 5),"Global")

     

    Sorry I guess this is a noob question...

     

    PS: The proxy is working of course - the error is the same with or without the proxy

  7. Ok, it seems the reqid is assigned for each "session" (e.g. 450186). Once the page is loaded, the reqid is set. If you reload the google profile, you get a fresh reqid. But the difference between the two ist the number of seconds that have passed between the refresh. That means the "reqid-to-be-assigned" is counting upwards with every second that passes. If 100 seconds have passed the new reqid will be 450286.

     

    The first digit of the reqid is a counter for the number of requests made with this reqid. In our example it would be the 4 in 450186. With every request this number counts up.

     

    Now we only need to figure out how the "50186" part of the "450186" reqid is generated in the first place. I would assume that it has something to do with a unix time difference. Possibly between dates given by headers resulting from GET requests to gstatic that occur on pageload?

  8. Hi all, I am trying to scrape Google reviews via socks.

     

    The problem: Google only displays approx. 8  reviews when the Google profile is loaded. The next batch of remaining reviews are loaded when the "More" button is pressed. I guess it is loaded via javascript. The Google Profile URL remains unchanged. 

    My question: Is there any way to scrape all reviews of a profile via socks?

     

    PS: I haven't tried Aymens HTTP Post plugin. Would it work with Aymens plugin? How?

     

    Any idea is appreciated. Thank you.

     

    -----

     

    I am sorry - I am very new to this so maybe none of this makes much sense - but here is what I have found so far:

     

    When the "more" button is pressed this is what happens (see below). So I figured I need to reconstruct the request URL and send s.th. to it via socket navigate POST. You can actually scrape the ozv= and the f.sid= parameter from the page first. I assume I can leave the avw= and the rt= as they are. But I dont know about the request ID. It seems to be generated with every click on the more-button.

     

    If I POST the request URL nothing happens. Maybe because of the false reqid. 

     

    Since I am new with this I dont know if I am completely on the wrong track...

     

    1. Request URL:

    https://plus.google.com/_/pages/local/loadreviews?ozv=es_oz_20150312.07_p1&avw=pr%3Apr&f.sid=-1412152857337063380&_reqid=640891&rt=j

    1. Request Method:

    POST

    1. Status Code:

     

    200 OK

    1. Request Headersview source
      1. Content-Type:

    application/x-www-form-urlencoded;charset=UTF-8

    1. Origin:

    https://plus.google.com

    1. Referer:

    https://plus.google.com/

    1. User-Agent:

    Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.1 (KHTML, like Gecko) Chrome/21.0.1180.83 Safari/537.1

    1. X-Same-Domain:

    1

    1. Query String Parametersview URL encoded
      1. ozv:

    es_oz_20150312.07_p1

    1. avw:

    pr:pr

    1. f.sid:

    -1412152857337063380

    1. _reqid:

    640891

    1. rt:

    j

    1. Form Dataview URL encoded
      1. f.req:

    ["6504450088010350842",null,[null,null,[[28,18,10],[30]]],[null,null,null,true,11,true],null,null,[360,2,[110,0]]]

    1. :
    1. Response Headersview source
      1. Alternate-Protocol:

    443:quic,p=0.5

    1. Cache-Control:

    no-cache, no-store, max-age=0, must-revalidate

    1. Content-Disposition:

    attachment; filename="response.bin"; filename*=UTF-8''response.bin

    1. Content-Encoding:

    gzip

    1. Content-Type:

    application/json; charset=utf-8

    1. Date:

    Sun, 15 Mar 2015 10:23:05 GMT

    1. Expires:

    Fri, 01 Jan 1990 00:00:00 GMT

    1. Pragma:

    no-cache

    1. Server:

    GSE

    1. Transfer-Encoding:

    chunked

    1. X-Content-Type-Options:

    nosniff

    1. X-Frame-Options:

    SAMEORIGIN

    1. X-XSS-Protection:

    1; mode=block

  9. Thanks for the clarification re the bulk variable!

     

    Just made a fresh install on a different pc and updated to 5.0.9. and the clipboard still doesnt work. Could it be that it clashes with another plugin (I only got datetime manipulation and advanced shell) or that I work on German language settings in windows? Sorry if that is all stupid nonsense I just dont have a clue and the plugin would be extremely valuable if it was working...

  10. I am on Win7 Ultimate 64 Bit using ubot Dev version 5.0.5. an am starting to guess something is wrong with my install. Although I have been working with this ubot install the last 6 months or so and all went well.

     

    Strange: I just tested the bulk variable plugin and this one also goes astray. Resetting one variable with the bulk variable command actually creates a new variable with the value that was meant to be overwritten!

     

    http://de.tinypic.com/view.php?pic=2195tg7&s=8

×
×
  • Create New...