Help!!! Google Search Engine Scraper

[JamesC 0]

Hey Guys,

 

Just got finished watching the video here:

 

It's a good tutorial on how to create a scraper for Google, but

I want to know if anyone can point me to the direction of what I need

for below.

 

Here's basically what I'm trying to do within Ubot.

 

1. Give a list of keywords

2. Have ubot get the top 10 results in Google for each keyword

3. Add those sites to a spreadsheet

4. Have ubot get the top 10 results in Bing

5. Add those sites to a spreadsheet

6. Have ubot get the top 10 results in Yahoo

7. Add those sites to a spreadsheet

(optional)

Then run a de-dupe process in the spreadsheet.

 

So the video above goes into the detail of creating the scraper, but

I'm stuck at looping the keywords to each search engine and also adding

them to a spreadsheet.

 

Note: Everything can be added to one spreadsheet by the way.

 

Thanks for your help guys,

 

James

[Big Jay 35]

James,

 

What do you mean by "Then run a de-dupe process in the spreadsheet." ?

 

I think he wants the duplicate URL's removed from the list.

[JamesC 0]

James,

 

What do you mean by "Then run a de-dupe process in the spreadsheet." ?

I'm a newbie but it seems to me, after reading your bot's task description, that what you're trying to do is not that difficult. Haven't watched the video clip as I'm on limited bandwidth.

 

Are you trying to create a "Searchengine Serp Scraper" or a "Meta Engine" ? Why re-invent the wheel when meta engines like mamma.com exist ?

 

Hi,

 

I'm trying to get the top 10 websites for each keyword because I want to eventually get the rss feed for each keyword. I have plans for them. (not evil plans, but plans. ;-)

 

And yes I am speaking of removing the duplicate entries of website urls.

 

James

[JamesC 0]

Which version are you using ? Standard ? Pro ? 3.5 ? 4 ?

 

I'm using the Standard version 4.0.94

 

Thanks,

 

James

[Pleini 0]

I wanted to download the updated .ubot file but I always get an error message "We could not find the attachment you were attempting to view."

Can anyone help me please?

 

Best.

Pleini