webpro 31 Posted March 19, 2014 Report Share Posted March 19, 2014 Anyone knows what's the max item you can add to a list ?For instance, i got something i need to scrape and do my thing that has 435 000 profiles (will be filled with profile urls to navigate too). If it's way too much, how do you guys handle this ?Thanks Quote Link to post Share on other sites
UBotDev 276 Posted March 19, 2014 Report Share Posted March 19, 2014 I've had a list of 1 000 000 URLs and it worked, the only down side was that loading that list took a few minutes and during that time it looked like UBot has frozen, but the list got eventually loaded and I was able to loop through it. 1 Quote Link to post Share on other sites
webpro 31 Posted March 19, 2014 Author Report Share Posted March 19, 2014 Thanks mate Quote Link to post Share on other sites
the_way 52 Posted March 20, 2014 Report Share Posted March 20, 2014 I done like ermmmm a billion, actually no, it was a trillian, took like a year to load Quote Link to post Share on other sites
Gogetta 263 Posted March 20, 2014 Report Share Posted March 20, 2014 If it's way too much, how do you guys handle this ?Thanks Set an if statement that when there is more than 10k items (or any number you want) in your list then append to file and clear the list. Just one way to help keep the memorey low. 1 Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.