Jump to content
UBot Underground

chameleon

Fellow UBotter
  • Content Count

    3
  • Joined

  • Last visited

Everything posted by chameleon

  1. Thanks HelloInsomnia, good idea. I guess I will have to weed out user agents from my list that return the google redirect url vs. the real url of the site. I assume that ubot browser limitations will prevent me from using serps with the non-encoded redirect url at all.
  2. But I don't want to just navigate to that url, or just record the position, I'd like google to see it as a click on the serp page. So I need to be able to click that link and have it take me to the page. Cool regex site you linked to, btw. That will come in handy.
  3. I'm pretty new to Ubot Studio and am attempting to scrape google serps using the following code (I'm sure this is familiar to most of you): add list to list(%scraped urls,$scrape attribute($element child(<class="r">),"href"),"Delete","Global") Typically, the href in class="r" results were listed as the url of each serp result, but with some user agent / ip combinations the hrefs on the serp page are the following, unencoded string: Old: http://www.kohls.com/catalog/barbie-dolls-doll-houses-toys.jsp New: http://www.google.com/url?url=http://www.kohls.com/catalog/barbie-dolls-doll-
×
×
  • Create New...