Ubot Unable To Scrape Xml Generated Page Text

[scriptbit 0]

I'm unable to scrape the page text from this url: http://ftr.fivefilters.org/makefulltextfeed.php?url=http:%2F%2Fwww.latimes.com%2Ftopic%2Fdisasters-accidents%2Ftransportation-disasters-accidents%2Ftraffic-accidents%2F03010001-topic.html&max=10

 

After checking the forum and  asking in the Skype Ubot group, several people said due to being XML that Ubot does not work with XML and said I needed a plugin to scrape the XML generated page text.

 

Several people recommended the XML plugin  found here: http://network.ubotstudio.com/forum/index.php/topic/13088-ubot-xml-plugin-ubot-discount/

 

However, after viewing the two training videos I see nothing of scraping XML web pages.   Perhaps I've got it wrong and this plugin can get this page text.

 

Can ANY of you please confirm whether or not this plugin is able to scrape the page text of the above  link which is XML generated?

 

If not possible with that plugin, then which one will do it or is it completely not possible with Ubot? (which I'm now thinking is the case)

Edited July 26, 2017 by scriptbit

[HelloInsomnia 1103]

I already answered this but now I can't find the thread so here you go:

set(#get,$read file("http://ftr.fivefilters.org/makefulltextfeed.php?url=http:%2F%2Fwww.latimes.com%2Ftopic%2Fdisasters-accidents%2Ftransportation-disasters-accidents%2Ftraffic-accidents%2F03010001-topic.html&max=10"),"Global")
set(#title,$plugin function("XpathPlugin.dll", "$Generic Xpath Parser", #get, "//item/title", "innertext", ""),"Global")
set(#originalArticle,$plugin function("XpathPlugin.dll", "$Generic Xpath Parser", #get, "//item/description", "innertext", ""),"Global")
set(#article,$replace($strip tags($unescape html(#originalArticle)),"Let\'s block ads! (Why?)",$nothing),"Global")

1. $read file function acts like a get request

2-3. scrape title and original article using this plugin (it's free): http://www.bot-factory.com/free-ubotstudio-xpath-plugin/

4. Clean it up with various functions you need to be subscribed for updates I believe but if you are not maybe somebody can make a regex for it instead.