N6CNH 0 Posted December 24, 2013 Report Share Posted December 24, 2013 Hi Guys, Firstly can I apologise for my poor coding terminology that is one of many things I hope to improve through this forum and this project that I am hoping you guys can help me with. So I have done masses of research on this subject and now it’s just time to ask for help!! So I am wanting to scrape Twitter, I have managed to create a .py code that does this for me when the shell is executed, however this is something currently done manually and the results are stored in a excel file and replaced every time the shell is run. What I would like is for the following; To create some code that scrapes all the tweets in the UK for one minute every hour on the hour. I want this code to be run automatically through a programme and the results to be stored in a database for example so trends can be analysed at a later date. Any help is VERY much appreciated, Thank you in advance, C. Quote Link to post Share on other sites
Edward_2 85 Posted December 24, 2013 Report Share Posted December 24, 2013 "all the tweets in the UK" Thats quite the goal... Quote Link to post Share on other sites
Code Docta (Nick C.) 638 Posted December 24, 2013 Report Share Posted December 24, 2013 This guy sells some example code here http://www.ubotstudio.com/forum/index.php?/topic/15615-sell-twitter-username-scraper-source-code-5-learn-and-earn/ Quote Link to post Share on other sites
N6CNH 0 Posted December 24, 2013 Author Report Share Posted December 24, 2013 "all the tweets in the UK" Thats quite the goal... Really? You think, finding scope was hard, I didnt think taking all the tweets for the UK for one minute of an hour would be that bad. I'm expecting what about 10,000 tweets? :/ Quote Link to post Share on other sites
pftg4 102 Posted December 24, 2013 Report Share Posted December 24, 2013 tj has a plugin that will run python from within ubot so you can use your code you wrote then from within ubot add to your database hope this helps Dave Quote Link to post Share on other sites
Edward_2 85 Posted December 24, 2013 Report Share Posted December 24, 2013 The second one down is interesting 278,000 tweets in the world for 1 min, so your probably about right. https://www.google.com/search?q=all+the+tweets+for+the+UK+for+one+minute http://blog.qmee.com/wp-content/uploads/2013/07/Qmee-Online-In-60-Seconds2.png Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.