Jump to content



Photo

Move Back And Forward Between List Items In A Webpage, Moving To Next Item


  • Please log in to reply
3 replies to this topic

#1 a-harvey

a-harvey

    Member

  • Members
  • PipPip
  • 22 posts
  • OS:Windows 8
  • Total Memory:More Than 9Gb
  • Framework:v3.5
  • License:Professional Edition

Posted 12 June 2018 - 05:10 AM

Hi,

Can someone give me some idea how to tackle the following.

I need to scrape the details from each of the lots listed within this page:

http://www.silversto...-2018/view_lots

 

I currently scrape all the list urls but need to scrape all the details on each page accessed via clicking the further details icon.

The problem is that they don't have a next lot button to cycle through the lots as most of my clients do, so you need to go back to the list and move down each lot on the above page, how would that be coded, ie click the first one and then scrape the date, move back then next etc.  my confusion is in moving down each lot on the above page.

 

My only thoughts were to scrape all the details pages and then pull them in via a csv and cycle through them, but their maybe an easier way.

 

Many thanks

Andrew



#2 hare ram

hare ram

    Advanced Member

  • Members
  • PipPipPip
  • 78 posts
  • LocationNew Delhi
  • OS:Windows 10
  • Total Memory:8Gb
  • Framework:v4.0
  • License:Professional Edition

Posted 13 June 2018 - 10:05 PM

you go like this step:

1.Scrape all url in a page and store in list.

2.After that in loop you have to open each url one by one

3.scrape all details in each url what you want and stored in table or list which is suitable for you.

4.Last save those stored data in csv file or Append to file.



#3 Marani

Marani

    Advanced Member

  • Community
  • PipPipPip
  • 217 posts
  • OS:Windows 10
  • Total Memory:4Gb
  • Framework:v3.5
  • License:Developer Edition

Posted 14 June 2018 - 01:38 PM

Scrape all urls and go through all of them using next list item inside a navigate command, now put the navigate inside a loop. for the loop count use list total



#4 a-harvey

a-harvey

    Member

  • Members
  • PipPip
  • 22 posts
  • OS:Windows 8
  • Total Memory:More Than 9Gb
  • Framework:v3.5
  • License:Professional Edition

Posted 18 June 2018 - 07:57 AM

Thank you both, I did think the bulk url download and then access maybe was the only way, and you have both confirmed my thoughts. I will try the next list item option as not used that previous.

 

Many thanks

Andrew






0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users