BigEfromDaBX 25 Posted March 22, 2018 Report Share Posted March 22, 2018 So I made a quick bot to scrape google search results. What I want to do scrape the results and visit those results to look for emails. So I got it working but then noticed that when I drilled down a few pages I got the captcha code. So what I did was threw 10 proxies in there and rotated them and didnt get the captcha page. I noticed that every search I get, I only get around 38 pages of results. Is that normal? What happens to the 100's of 1000's results that google reports for your search? Thanks. Quote Link to post Share on other sites
bestmacros 60 Posted March 22, 2018 Report Share Posted March 22, 2018 that is normal - google does not show all results it finds - only top 30-50 pages 1 Quote Link to post Share on other sites
BigEfromDaBX 25 Posted March 22, 2018 Author Report Share Posted March 22, 2018 that is normal - google does not show all results it finds - only top 30-50 pagesThanks Quote Link to post Share on other sites
HelloInsomnia 1103 Posted March 22, 2018 Report Share Posted March 22, 2018 Google shows at most 1000 results, you can query up to 100 results per page which is most efficient. So max 10 pages per keyword. Even if there are millions of results on a per keyword basis you can only see the top 1000. 1 Quote Link to post Share on other sites
BigEfromDaBX 25 Posted March 22, 2018 Author Report Share Posted March 22, 2018 Google shows at most 1000 results, you can query up to 100 results per page which is most efficient. So max 10 pages per keyword. Even if there are millions of results on a per keyword basis you can only see the top 1000.Thanks. Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.