Jump to content
UBot Underground

Pete_UK

Members
 View Profile  See their activity

  • Content Count

    133

  • Joined

  • Last visited

  • Days Won

    2

 Content Type 

Posts posted by Pete_UK

  3. [Free] Plugin Large Data

    in Plugins

    Posted

    ...

     

    Another thing I wanted to mention, not all large data commands are thread save. 

    So I would not use large list from text within a thread to save data to a shared large data list.

     

    Dan / Kev,

     

    Can you mention which commands are thread safe and which are not?

    • Like 1

  7. [Free Plugin] HMCA SHA1 encryption

    in Plugins

    Posted

    it needs to be base64 hash

     

    also

     

    SignatureMethod — The HMAC hash algorithm you are using to calculate your signature. Both HmacSHA256 and HmacSHA1 are supported hash algorithms, but Amazon recommends using HmacSHA256.

     

    hmacsha1 and the required output format is already included in this plugin?

    Yes, SHA1 is working fine. No issues right now. In emails I've had from the Amazon dev support team they have eluded to dropping SHA1 support in the future ... hence my post asking about SHA256.

  13. [Free] Plugin Large Data

    in Plugins

    Posted

    Hi Kev,

     

    Is it safe to use large lists and large tables in threads? I'm just about to convert a single threaded bot to multi-threaded and thought I'd ask before hitting any stumbling locks.

     

    While I'm at it... Do large lists / large tables work okay inside threads using your Smart Threads plugin?

  14. [Sell] - Http Plugin Tutorial Video Series

    in Training

    Posted

    Hi Pete,

     

    thanks for the video. The main question is:

    Do you want to render and see the webpage with all the details. Or do you only need the values and numbers who are returned?

     

    The http plugin can not execute javascript. 

     

    But when you press the Calculate button, that's another HTTP post request. So you can simulate that, and you will get all the data that is returned and shown on the page. So then you can use that data. 

    But you can't render and show the page. 

     

    I mean, using the http plugin has a different usecase, it's best for extracting lot's of data very quickly. Because we are not rendering and dealing with all the browser related stuff.

    But if you want to see and show the website to your users, well.. then it's best to just work with the ubot browser. 

     

    So the question really is, what information's do you need and what do you want to do with them? 

    You can get all the numbers and values via HTTP plugin. Even the numbers that are shown after pressing the calculate button. 

     

    But you can not render and show the exact same amazon html page afterwards. That's not possible. Well, at least not within a reasonable time. And I really don't see a reason why you want to do that.

     

    So in my opinion there are two usecases:

    1. You want to extract lot's of data.

    Use http plugin. 

    Show the value in a table or build your own html code to present the data

     

    2. You want the exact same look and feel as on the amazon page.

    Use the ubot browser.

     

    If you can describe your overall goal with this, we can discuss this further. You can also PM me if you don't want to share it publicly. 

     

    Cheers

    Dan

     

    As a little history.... I started using the Ubot browser but for some reason with this page, it acts so inconsistently. I think this is something to do with the javascript rendering. I will not bother going into details on this but it was the inconsistent nature of the page in ubot that got me thinking of using the http plugin. I was hoping to get the data through post/get requests and then workout how to 'plug' the data back into the webpage to see the charts rendered.

     

    It's the last step that really got me stuck.

     

    Anyway, yes I totally agree that the http plugin is great for getting the data but it has nothing to do with working out what magic needs to be done to get the returned data back into the rendered webpage.

     

    I've got the data coming through the plugin so I think my easiest route forward is to stick with the data and may be look at rendering it in a chart myself at a later date. Having the data is the main thing.

  15. [Sell] - Http Plugin Tutorial Video Series

    in Training

    Posted · Edited by Pete_UK

     

    Hello Pete,

     

    I'm not 100% sure what your question is....

     

    The search query is executed by a post request. That request has two parameters:

    method

    model

     

    And the value for the model parameter looks like:

    {"searchString":"B00CG5X4XC","lang":"en_US","marketPlace":"ATVPDKIKX0DER"}

     

    So this should be very easy to create.

     

    Now when you run that post request you will get the following return:

     

    {"data":[{"link":"http://www.amazon.com/gp/product/B00CG5X4XC/ref=xx_xx_cont_xx","dimUnits":"inches","thumbnail":"https://images-na.ssl-images-amazon.com/images/I/41DxD4dyzqL._SL80_.jpg","subCategory":"2102020","dimensions":{"width":4.7,"length":8.2,"height":2.8},"gl":"gl_toy","image":"https://images-na.ssl-images-amazon.com/images/I/41DxD4dyzqL._SL120_.jpg","weightUnits":"pounds","productGroup":"21","weight":0.3,"asin":"B00CG5X4XC","whiteGlovesRequired":"N","title":"Beyblade Shogun Steel BeyWarriors BW-08 Pirate Orochi Battler [Toy]"}],"errorMessage":null} 

     

     

    Now you can extract the product URL from that return.

    http://www.amazon.com/gp/product/B00CG5X4XC/ref=xx_xx_cont_xx

     

     

    Not sure if that answers your question? If not, I need more details about what you actually try to do.

     

    Dan

     

    Hi Dan,

     

    Sorry for not being clear on my question.

     

    A Post request returns data fine but the main issue I have is... the data is just some 'data' that the existing webpage processes via javascript. Once the page updates it then makes the CALCULATE button available that generates another post request that brings back more data that is again used by javascript.

     

    So my query is... how can I get the http requests trigger the page update using the json data that allows the Calculate button to become active.

     

    Here is a video that I hope explains it a little better: http://screencast.com/t/LpMwZ8moP4W

     

    Thanks,

    Pete

     

    PS. I will ad.... I think the answer will be something like .... there is no easy way around it. It's not an issue with the http request but more how the data is processed.  :)  

  16. [Sell] - Http Plugin Tutorial Video Series

    in Training

    Posted

    Hi Mamica,

     

    it's very important to understand the concept of the http...

    ...

    ...

    Example:

    A website has a button with: More informations.

    This is javascript code. So when you click the button the website will execute a small javascript snipped. But the necessary information is not available on the site. Then there will be another http call to receive the additional informations from the webserver. And you can "fake" that call with http plugin.

    Hi Dan,

     

    I've been looking at using the http plugin with this is https://sellercentral.amazon.com/gp/fba/revenue-calculator/index.html/ref=xx_xx_cont_xx?ie=UTF8&lang=en_US

     

    From the quote above it looks like this site falls into 'could be tricky' category.

     

    It's easy to create a Post request with the 2 parameters (fiddler show METHOD & MODEL) required for the ASIN/PRODUCT search but as this search is controlled via javascript the results returned are not a webpage but son data instead. See image in the link below.

     

    http://screencast.com/t/z4US7yXOwrl1

     

    Do you have any pointers to help me figure out how to get the results rendered?

     

    May be this would make a good video if you know of a solution. Or, maybe the page is too complex for http,

     

    Thanks,

    Pete

  18. [Sell] - Http Plugin Tutorial Video Series

    in Training

    Posted

    It's actually V5.5 :-) I did a  lot of beta tests and the 5.5 release is running fine for me. 

    And the improved loading time is one of the main reasons for me to switch. As long as everything else is similar or better than v4, I'm fine with the switch.

     

    Http plugin also works fine with 5.5. Threading is fixed as well in 5.5 so I think I'm ready for the switch.

     

    Dan

    That great to hear Dan. I'm looking forward to it's release.

  22. Dev Needed

    in Services

    Posted

    I think I know someone for this. Any rough value on the budget by any chance? smile2.png

    I have a few people helping me out right now so I don't need anyone else at the moment.

     

    Will definitely need some more in a few weeks though so I'll post on this thread then.

     

    Thanks.

  24. Dev Needed

    in Services

    Posted

    I have too much work on so need an experienced UBOT Developer to help out with a few projects.

    First project....

    Spider/Scraper to get data from walmart to save to a CSV file. Pretty Easy.

    Input: Category to spider/scrape
    Output: CSV file containing: Product Name, URL, Price, UPC, Avg Rating, # Review

     

    Make it multi-threaded and fast.
     

    No fancy UI needed. Just produce the code that works (not compiled).

    Skype me: pete_m1 to discuss.

  25. Ubot XML plugin - Ubot Discount

    in Plugins

    Posted

    Not sure is this is a bug Aymen.

     

    A bit of trial and error with the XML file shows that the plugin doesn't like the defined default namespace on the 2nd line...

     

    <?xml version="1.0"?>
    <GetMatchingProductResponse     xmlns="http://mws.amazonservices.com/schema/Products/2011-10-01">
    <GetMatchingProductResult ASIN="B00DY1WVNQ" status="Success">
        <Product>
            <Identifiers>
                <MarketplaceASIN>
                    <MarketplaceId>ATVPDKIKX0DER</MarketplaceId>
                    <ASIN>B00DY1WVNQ</ASIN>
                </MarketplaceASIN>
            </Identifiers>
            <SalesRankings>
                <SalesRank>
                    <ProductCategoryId>toy_display_on_website</ProductCategoryId>
                    <Rank>22212</Rank>
                </SalesRank>
                <SalesRank>
                    <ProductCategoryId>toy_display_on_website</ProductCategoryId>
                    <Rank>22212</Rank>
                </SalesRank>
            </SalesRankings>
        </Product>
    </GetMatchingProductResult>
    <GetMatchingProductResult ASIN="B004NXG9IC" status="Success">
    </GetMatchingProductResult>
    </GetMatchingProductResponse>
     
    Can to plugin handle NameSpaces?
×
×
  • Create New...