deliter 203 Posted June 23, 2016 Report Share Posted June 23, 2016 Hey Ive planned on selling this but I don't have the time and too much effort so I will give it for free 6 functions Easy HTML ParserCSS SelectorCSS Selector Element OffsetCSS Child SelectorCSS Sibling SelectorCSS Change Attribute Its a very much needed tool so download it and learn how to use it,your scraping will be enhanced 10 fold,I am new to this too and am only scratching the surface of its power Here is an example of how easy it is using firefox,with firebug and firepath plugins installed say I want to scrape all the titles of a google search result I simply right click over a title and select "inspect with firepath"http://imgur.com/sCCfHoS then all titles are highlighted,kind of jagged dotted line surrounds them and the CSS Path is generated inside of firepath I now have the code the scrape titles with http get set(#http get,$plugin function("HTTP post.dll", "$http get", "http://www.google.com/search?q=ubot+studio", "", "", "", ""),"Global") add list to list(%titles,$plugin function("DeliterCSS.dll", "Deliter CSS Selector", #http get, ".r>a", "TextContent"),"Delete","Global") alert(%titles) The out of the box tools are awesome to get 90% of what you need,for individual elements,just click copy css path usually beside a copy xpath,in the developer tools,I would still recommend learning CSS Paths so that you can write your own,its amazing stuff CSS also supports wildcard selectors a useful reference page would be http://www.w3schools.com/cssref/css_selectors.asp A wildcard would be needed for say scraping email hrefs from a page,consider this HTML <a href="mailto:example@example.com">Click here to mail me!</a> the path would be a[href^=mailto:]a being the tag,href being an attribute of the tag,and the regex,starts with mailto: I use and recommend pinegrow for building UI's its pretty expensive but some very nice features,you can load a URL page into pinegrow and their CSS Selector is far superior to firepath, I am sure their are plenty of alternatives to firepath and better ones so if you come across one please share it CSS Selector https://1drv.ms/u/s!AgO9AudYbciJgP8ZAkIdZ6ICeNRCWQ 3 Quote Link to post Share on other sites
abbas786 78 Posted June 24, 2016 Report Share Posted June 24, 2016 Thanks for your contribution mate. A must have plugin along with Dan's Free Xpath Plugin 1 Quote Link to post Share on other sites
deliter 203 Posted June 24, 2016 Author Report Share Posted June 24, 2016 edit Quote Link to post Share on other sites
iamddr 12 Posted June 24, 2016 Report Share Posted June 24, 2016 Just tried this plugin, Complete product level plugin, thank you for sharing it for free.Thank you, deliter 1 Quote Link to post Share on other sites
deliter 203 Posted August 4, 2016 Author Report Share Posted August 4, 2016 Hey Added a scrape multi attribute feature,it returns a simle JSON object,Ayman has a free JSON Parser, the point of it is so your not writing multiple lists when scrape the same element,and probably adding to table etc,saves a lot of work Example,you are scraping href links and you want a seperate list of innertext of the links,you make two lists etc,especially sites with lots of data attributes you can just use this one node load html("<a href=\"example.com1\">hi1</a> <a href=\"example.com2\">hi2</a> <a href=\"example.com3\">hi3</a> ") add list to list(%data,$plugin function("DeliterCSS.dll", "Deliter CSS Selector MultiValue", $document text, "a", "href,TextContent"),"Delete","Global") alert($plugin function("JSONpath.dll", "$JSONpath parser", $list item(%data,0), "TextContent")) Quote Link to post Share on other sites
kate 5 Posted August 12, 2016 Report Share Posted August 12, 2016 Thank you deliter for sharing this 1 Quote Link to post Share on other sites
Eddie 14 Posted October 11, 2017 Report Share Posted October 11, 2017 the download link do not word, is anybody have this to update the link, thanks!! Quote Link to post Share on other sites
HelloInsomnia 1103 Posted October 11, 2017 Report Share Posted October 11, 2017 Because he had a direct download link and the link is dead I'll post the version of this plugin that I have and maybe Deliter can update his link (although he hasn't been on in a few months now) https://drive.google.com/open?id=0BwVXAzqDuS_8RVcyRDA5R0FaeUU Quote Link to post Share on other sites
Eddie 14 Posted October 12, 2017 Report Share Posted October 12, 2017 Because he had a direct download link and the link is dead I'll post the version of this plugin that I have and maybe Deliter can update his link (although he hasn't been on in a few months now) https://drive.google.com/open?id=0BwVXAzqDuS_8RVcyRDA5R0FaeUUthank you! Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.