Jump to content
UBot Underground

Recommended Posts

Anyone knows what's the max item you can add to a list ?

For instance, i got something i need to scrape and do my thing that has 435 000 profiles (will be filled with profile urls to navigate too).

 

If it's way too much, how do you guys handle this ?

Thanks

 

Link to post
Share on other sites

I've had a list of 1 000 000 URLs and it worked, the only down side was that loading that list took a few minutes and during that time it looked like UBot has frozen, but the list got eventually loaded and I was able to loop through it.

  • Like 1
Link to post
Share on other sites

If it's way too much, how do you guys handle this ?

Thanks

 

Set an if statement that when there is more than 10k items (or any number you want) in your list then append to file and clear the list. Just one way to help keep the memorey low.

  • Like 1
Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
×
×
  • Create New...