Api How Do They Interact With Page Buttons

[Dallashox 2]

Can someone clarify how the UBOT or how API’S work in general such as in UBOT and ones such as scrapy.  If you had a page with dynamic generated links or if you wanted to click a button, you can’t really do this through an API can you?  Someone told me that you only download the webpage as a source and then parse it.  It saves CPU but you can’t really interact with the webpages…

As an example say I wanted to go here:

 https://www.amazon.com/s/ref=nb_sb_noss_2?url=search-alias%3Daps&field-keywords=monitors

Then I wanted to click next 400 times and scrape amazon monitors data for each uniquely generated page with unique url that is dynamic..  This can be achieved in ubot but can this be done with an API such as http post plugin.

I might investigate it a lot more as I hear so many conflicting stories about how API’s are good/bad.

 

[HelloInsomnia 1103]

Amazon has APIs which allow you to retrieve data from their databases. You could use something like the HTTP Post plugin to work with one of their APIs.

 

Scrapy is a Python library and its more for web scraping than communicating with APIs (as far as I know at least). For clicking the button you are talking about interacting with the website directly and not via something like a web API. So no that's not how it works.

 

You can download web pages and scrape the info out of them, but maybe what they meant by download is just using something like an HTTP Get request to get the source code. I don't see the point in saving the page unless you need it later.

 

You can use HTTP Post plugin in Ubot for both interacting with web APIs as well as using get requests to get webpages. Clicking on buttons may involve HTTP Post requests. Or you may be able to manipulate the URL instead. I suggest checking out Dans tutorials to help you understand what's possible: http://www.bot-factory.com/http-plugin-tutorials/