APTS 3 Posted August 13, 2015 Report Share Posted August 13, 2015 (edited) Calling all uBot coders for hire! I have a bunch of static html files and I need a bot that will extract all of the data and then save it in table format. All of the text files are formatted in the same way, although there are some subtle differences between the files. Some of the files have more details than others, but in each case I need to ensure that all of the data is scraped and saved. I believe that this task should be done using regex to extract the data, but if you have a better idea for how to scrape the data, I am open to your suggestions. As long as it works properly, I will be happy. I have attached 5 sample files for your review. Here is a partial snapshot of how the data looks: http://i827.photobucket.com/albums/zz196/Daniel_Attard/ubot_zpshqaxlxxb.pngW3275917.htmlN3232705.htmlE3281631.htmlN3240566.htmlE3275145.html Edited August 13, 2015 by APTS Quote Link to post Share on other sites
Code Docta (Nick C.) 638 Posted August 14, 2015 Report Share Posted August 14, 2015 this is prolly really close to what you want just put those html files in a folder called data and run the bot from a folder need large data plugin (free xpath) clear list(%page scrape)clear list(%files)add list to list(%files,$get files("{$special folder("Application")}\\Data","Yes"),"Delete","Global")loop($list total(%files)) { navigate($next list item(%files),"Wait") plugin command("Bigtable.dll", "Clear large list", "scraped") plugin command("Bigtable.dll", "large List from Xpath", "scraped", $document text, "//span[@class=\'formitem formfield\']//text()", "replace") plugin command("Bigtable.dll", "Large list Remove duplicates", "scraped") add item to list(%table rows,"--{$plugin function("Bigtable.dll", "Large list total", "scraped")}--{$text from list($list from text($plugin function("Bigtable.dll", "Large list return", "scraped"),$new line),",")}","Don\'t Delete","Global")} I can send you PP info and suggested price(tip) if you like. Hope this helps,CD 1 Quote Link to post Share on other sites
bestmacros 60 Posted August 14, 2015 Report Share Posted August 14, 2015 looks familiar 1 Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.