Jump to content
UBot Underground

How do I add to list from multiple page Scraping without saving over existing list?


Recommended Posts

I'm having a difficult time with the "add to list" command. Tutorials show how to save to file after scraping ONE page. But obviously i want to be able to scrape multiple pages and adding to list... and then save simultaneously without clearing the list each time. any idea?

Link to post
Share on other sites

The list does not get cleared or overwritten until you clear it. Take the save file outside of the loop and add your navigation (to successive pages inside the loop. It will keep adding to the list until the loop is done at which point it will save the entire list to a file.

Link to post
Share on other sites
  • 4 months later...

No doubt a Loop/While will work. That's what we do now. My comment was we (psst. might) do not have a Append List node ...yet. lol But my fingers are crossed.

 

please please please let this be on the next version

Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
×
×
  • Create New...