Jump to content
UBot Underground

Sorting Scraped Data In .csv


Recommended Posts

Hi UBoters,

 

For a long time now I used IMacro to create small bots and moved to UBot few days back and I am loving it :rolleyes:

 

 

OK back to business...

 

I have one page that I am trying to scrape data from but have small problem...

 

Page I am trying to scrape is similar to old Free Google Keyword tool without the Captcha... here is video of the page and data to scrape:

 

http://bit.ly/9B8nSf

 

so the process is as follows:

 

Navigate to page => Insert Word in to field (word inserted from feed.txt file which is on my HD) => Click Submit Button => Save scraped data to a List => Than save all to .csv file

 

Everything above is working as I want it (looping and all other) but problem is in saved data... it all comes in first column all data same as it did in "Building a Keyword Research Bot (Old Version)" Video Here is the link to video http://vimeo.com/6805724

 

When I chose data to be scraped I go with outherhtml and use wildcard:

 

<TD class=darkgray12 vAlign=top align=left>*</TD>

 

Now entire table is scraped like this:

 

Timestamp Line 1

First Name Line 1

Last Name Line 1

Email Line 1

Timestamp Line 2

First Name Line 2

Last Name Line 2

Email Line 2

Timestamp Line 3

First Name Line 3

Last Name Line 3

Email Line 3

 

And I want it in .csv like this:

 

Timestamp Line 1 First Name Line 1 Last Name Line 1 Email Line 1

Timestamp Line 2 First Name Line 2 Last Name Line 2 Email Line 2

Timestamp Line 3 First Name Line 3 Last Name Line 3 Email Line 3

 

I have tried to use loop option and than add to new list as shown in "Building a Keyword Research Bot (Old Version)" (minute 24 in video) but it comes back with this error:

 

http://www.myonlineoffice.info/video/2010-11-11_1557.png

 

and can not finish creating table,

 

I have loop cycles as list total as you can see from the image above...

 

Thank you all in advance for your help,

Link to post
Share on other sites

Hi UBoters,

 

For a long time now I used IMacro to create small bots and moved to UBot few days back and I am loving it :rolleyes:

 

 

OK back to business...

 

I have one page that I am trying to scrape data from but have small problem...

 

Page I am trying to scrape is similar to old Free Google Keyword tool without the Captcha... here is video of the page and data to scrape:

 

http://bit.ly/9B8nSf

 

so the process is as follows:

 

Navigate to page => Insert Word in to field (word inserted from feed.txt file which is on my HD) => Click Submit Button => Save scraped data to a List => Than save all to .csv file

 

Everything above is working as I want it (looping and all other) but problem is in saved data... it all comes in first column all data same as it did in "Building a Keyword Research Bot (Old Version)" Video Here is the link to video http://vimeo.com/6805724

 

When I chose data to be scraped I go with outherhtml and use wildcard:

 

*

 

Now entire table is scraped like this:

 

Timestamp Line 1

First Name Line 1

Last Name Line 1

Email Line 1

Timestamp Line 2

First Name Line 2

Last Name Line 2

Email Line 2

Timestamp Line 3

First Name Line 3

Last Name Line 3

Email Line 3

 

And I want it in .csv like this:

 

Timestamp Line 1 First Name Line 1 Last Name Line 1 Email Line 1

Timestamp Line 2 First Name Line 2 Last Name Line 2 Email Line 2

Timestamp Line 3 First Name Line 3 Last Name Line 3 Email Line 3

 

I have tried to use loop option and than add to new list as shown in "Building a Keyword Research Bot (Old Version)" (minute 24 in video) but it comes back with this error:

 

http://www.myonlineoffice.info/video/2010-11-11_1557.png

 

and can not finish creating table,

 

I have loop cycles as list total as you can see from the image above...

 

Thank you all in advance for your help,

 

For that error, simple go to the variable commands and drag in the Set List Position command. Set the content the parameter window for that command to 0. Place the command outside of the loop, not inside it. Have it before the loop.

Link to post
Share on other sites

For that error, simple go to the variable commands and drag in the Set List Position command. Set the content the parameter window for that command to 0. Place the command outside of the loop, not inside it. Have it before the loop.

 

Hi LillyT,

 

Thank you for quick reply...

 

I have tried to do as you explained above but still getting same error,

 

What i have done is attached that part of script with sample results1.txt file... I would appreciate if you can have a quick look at it (Ill pay for your help just send me paypal email no problem)...

 

Thank you in advance :)

v0.01.zip

  • Like 1
Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
×
×
  • Create New...