smvsuccess 0 Posted April 17, 2012 Report Share Posted April 17, 2012 I'm trying to build a script that can scrape data from a webpage andsave it in a csv file. The bot will have to visit around 5000 links, and each time it visits one, it will have to create a new row to an existing csv with new information. The bot will run multiple times, so how can i make sure it adds to the rows below and not override previous rows? The csv i'm building will have around 5000 rows and 4-5 columns each... Thank you! Quote Link to post Share on other sites
keiooz 1 Posted April 17, 2012 Report Share Posted April 17, 2012 There are a lot of software that can only do such task. You can simply get online and if possible, check how it should be done.http://imagicon.info/cat/5-34/vbulletin-eek.gif Quote Link to post Share on other sites
Legend 181 Posted April 17, 2012 Report Share Posted April 17, 2012 Should be easy enough to increment in a loop if your doing it all in one go... Alternatively you can save the current contents of the csv file to a list then use add to list (which won't overwrite the previous list items). When your done just save it all to the csv... Or something like that... http://ubotstudio.com/forum/public/style_emoticons/default/rolleyes.gif Quote Link to post Share on other sites
LoWrIdErTJ - BotGuru 904 Posted April 17, 2012 Report Share Posted April 17, 2012 load previous csv into a list then add new item to list and data needed, then save it as csv Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.