Search the Community
Showing results for tags 'bot crashes'.
Hi guys, I am trying to create a bot that will scrape whois registrar information from the following site: https://whois.icann.org/en It basically takes a list of website URLs and passes them into the site. Once it does that it will scrape the email address off from the site based on the contact information presented. The bot is fairly simple but I've been running into some bot breaking glitches that won't allow the bot to run past around 1400 results. I can leave the bot on running for several thousand results but after around 1400, it'll stop scrapping the email addresses and saving them