davidford76 12 Posted March 13, 2014 Report Share Posted March 13, 2014 It has been a long time since I have messed around with ubot I am working on getting back into it again. But my question is how can I scrape a forum? I am wanting to click on a topic then scrape the whole page on that topic. Then be able to go to the next topic and do the same thing again. I have been trying to do scrape attribute with inner text, outer text, and etc. and I am not having any luck. Some advice on this would be appreciated. Quote Link to post Share on other sites
Bot-Factory 602 Posted March 13, 2014 Report Share Posted March 13, 2014 There is no generic anwser to this question. This highly depends on the structure of the forum. General speeking you would use the attributes commands or a regex query. But we would need an example to really help you. Dan Quote Link to post Share on other sites
UBotBuddy 331 Posted March 13, 2014 Report Share Posted March 13, 2014 Question @davidford76 Are you trying to scrape seperate Posts within a single Thread? Buddy Quote Link to post Share on other sites
the_way 52 Posted March 14, 2014 Report Share Posted March 14, 2014 Its easier to first scrape the high posters, and then scrape what they are posting if its a larger forum. Or there should be a link on the forum that allows you to show the newest posts, and you can just keep refreshing that page and scrape the thread urls from there. Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.