More than 3000 Records

[SmileyBot 13]

Hey, I always have problems with ubot when scraping more than 3000+ records, I need to scrape 36k records and it doesn't look like I'm going to be able to it in one session, any ideas,

[SmileyBot 13]

Hey, I always have problems with ubot when scraping more than 3000+ records, I need to scrape 36k records and it doesn't look like I'm going to be able to it in one session, any ideas,

I have worked out the problem "dont use ubot" use shitty imacro instead as you will never have this issue ,I refuse to spend time to make an automated bot and have to go back and work out which record has been scraped or not, what a joke,  ,

[gavind 6]

3k records is a bit too large to handle I think. In the future, I guess this will be made possible. 

[blumi40 222]

i got lists with 70k records and it works

depence on your ram and also how big a record are.

two options

1. split your list   

2. use mysql or sqlite