This is driving me NUTS!

[Martin 0]

Hi guys,

 

I'm a little stuck. The bot I'm working is basically supposed to:

 

1) Load list of domains from a file into a list

2) Go to Yahoo!'s domain explorer and do a search

3) Scrape the backlinks (just on the first page of Yahoo's results)

4) Then write the domain that was checked along with the backlink URLs into the first row in a csv

 

The resulting file should look like this in principle:

 

Domain1,backlinkURL1,backlinkURL2,backlinkURL3,backlinkURL4, etc.

Domain2,backlinkURL1,backlinkURL2,backlinkURL3,backlinkURL4, etc.

Domain3,backlinkURL1,backlinkURL2,backlinkURL3,backlinkURL4, etc.

Domain4,backlinkURL1,backlinkURL2,backlinkURL3,backlinkURL4, etc.

etc.

 

How do I accomplish this? The main issue I'm having is how to save a list of URLs to a row in a csv every time I go through the loop?

 

Martin

[Biks 9]

Check out Seth's tutorial on building a Google keyword scraper tool. He goes over scraping and saving things into a .csv file.

 

Seth's Google keyword tool tutorial

 

Just pulling this outta my butt, I'm guessing it would look like this:

 

{1},{2},{3},{4} $newline

 

When your saving what you scraped, you'll add a comma between the {1} variables, then program a $newline into it which brings you to the next row of cells.

 

Again, I ask too many questions around here myself. I could be horribly wrong. :-)