Jump to content
UBot Underground

scraping search results google and bing


Recommended Posts

Is anyone having success scraping google or bing search results? used to be pretty straightforward but now advanced element edit just hangs and when it finally comes around, it doesn't scrape search results (Href) for me. Have tried page scrape and attribute scrapes but none are  working. 

Link to post
Share on other sites

Thanks for that. Greatly appreciated. It works well though I see you're using regex - my problem is getting to advanced editor on scrape attribute on sites like Google/Bing just seems to freeze ubot. I have 6gb ram and 1 tb hard drive so shouldn't be a problem.

Link to post
Share on other sites

One thing to learn is how to search the engine database by filling in the search URL manually. This will help greatly. Plus dig into each search engine options to get back more results per search. Hint, they will give you back at least 50 results in one search.

Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
×
×
  • Create New...