zharfan 0 Posted May 21, 2014 Report Share Posted May 21, 2014 what is the command using http post for scrape google result? And i plan to scrape all link in the google web result. Please help me thanks for help me Quote Link to post Share on other sites
Gogetta 263 Posted May 21, 2014 Report Share Posted May 21, 2014 ui text box("Keyword:", #Keyword) ui stat monitor("Links:", $list total(%links)) set(#google_results, $plugin function("HTTP post.dll", "$http get", "https://www.google.com/search?q={#Keyword}", $plugin function("HTTP post.dll", "$http useragent string", "Firefox 27.0 Win7 64-bit"), "", "", ""), "Global") clear list(%links) add list to list(%links, $plugin function("HTTP post.dll", "$xpath parser", #google_results, "//div//h3//a[contains(@onmousedown,\'rwt\')]", "href", "HTML"), "Delete", "Global") Quote Link to post Share on other sites
zharfan 0 Posted May 21, 2014 Author Report Share Posted May 21, 2014 thanks gogetta, but how to scrape all google web page result ? Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.