drstew 1 Posted May 4, 2011 Report Share Posted May 4, 2011 Hey Guys, I thought this was pretty easy to do but for some reason my little bot will only get the first URL in the list. I'm sure this is something very easy for someone to point out what I'm doing wrong. Thank you.scrapeMetaKeywords.ubot Quote Link to post Share on other sites
UBotBuddy 331 Posted May 4, 2011 Report Share Posted May 4, 2011 @drstew, check this bot out. In a nutshell, the site you are visiting needs to have that data setup in their html tags for these two nodes to work.meta-test.ubot Quote Link to post Share on other sites
drstew 1 Posted May 4, 2011 Author Report Share Posted May 4, 2011 Thank you for the response BotBuddy. My issue is I have a list of URL's that I want to grab the meta keywords and description for each one. It grabs the first URL's meta data and thats it. When using the $meta keyword nodes do they just pick up the metadata automatically if a site has it listed in it's head tags? Quote Link to post Share on other sites
UBotBuddy 331 Posted May 4, 2011 Report Share Posted May 4, 2011 Yes, just use that node AFTER your site has been loaded using the Navigate node. Quote Link to post Share on other sites
drstew 1 Posted May 4, 2011 Author Report Share Posted May 4, 2011 I must be tired. As it turns out my bot is actually working correctly Quote Link to post Share on other sites
John Martin 0 Posted May 5, 2011 Report Share Posted May 5, 2011 Its informative one provide a lots of data on topic also provide more infomation on topic. Quote Link to post Share on other sites
Guest leahDyou Posted June 5, 2011 Report Share Posted June 5, 2011 This is nice, sharing more information to one's already good idea. Quote Link to post Share on other sites
rocket976 62 Posted March 26, 2012 Report Share Posted March 26, 2012 any updates on the usage of $metadata with ubot4, the attached ex code is not valid for 4... Quote Link to post Share on other sites
winincome 3 Posted April 2, 2012 Report Share Posted April 2, 2012 any updates on the usage of $metadata with ubot4, the attached ex code is not valid for 4... I use set(#metadesc, $scrape attribute(<outerhtml=w"<meta name=\"description\" *>">, "content"), "Global") for meta description and presumably similar would work for any other meta stuff like keywords hope that helps Chris 1 Quote Link to post Share on other sites
rocket976 62 Posted April 3, 2012 Report Share Posted April 3, 2012 Great thanks I figured it out but never left details for others.. Like you just did, thx... Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.