ekvador 6 Posted January 17, 2016 Report Share Posted January 17, 2016 All search engines ( google, bing , yahoo..) alow up to 1000 results . How works big black hat parsers, like Hrefer and others, they can scrape for one keyword 10.000-100.000 websites ? I mean, ok proxies must have, but all engines alow first 1000 results ? Quote Link to post Share on other sites
HelloInsomnia 1103 Posted January 17, 2016 Report Share Posted January 17, 2016 They don't, Hrefer has a word database and probably adds the words to the keyword to get more results. Google for example only shows 1,000 results for a keyword like you said. You can scrape similar keywords, suggested results and add letters or more words to come up with other keywords from one single keyword and end up with a lot more results (by scraping for those other keywords as well). 2 Quote Link to post Share on other sites
ekvador 6 Posted January 17, 2016 Author Report Share Posted January 17, 2016 yes, this is logic, similar keywords or example main keyword+ some script engine, keyword+ wordpress, or keyword+ smf .... Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.