Can someone give me some idea how to tackle the following.
I need to scrape the details from each of the lots listed within this page:
I currently scrape all the list urls but need to scrape all the details on each page accessed via clicking the further details icon.
The problem is that they don't have a next lot button to cycle through the lots as most of my clients do, so you need to go back to the list and move down each lot on the above page, how would that be coded, ie click the first one and then scrape the date, move back then next etc. my confusion is in moving down each lot on the above page.
My only thoughts were to scrape all the details pages and then pull them in via a csv and cycle through them, but their maybe an easier way.