Jump to content
UBot Underground

Css Selector Plugin [Free]


Recommended Posts

Hey

 

Ive planned on selling this but I don't have the time and too much effort so I will give it for free

 

6 functions 

 

Easy HTML Parser

CSS Selector

CSS Selector Element Offset

CSS Child Selector

CSS Sibling Selector

CSS Change Attribute

 

Its a very much needed tool so download it and learn how to use it,your scraping will be enhanced 10 fold,I am new to this too and am only scratching the surface of its power

 

Here is an example of how easy it is using firefox,with firebug and firepath plugins installed

 

say I want to scrape all the titles of a google search result

 

I simply right click over a title and select "inspect with firepath"

http://imgur.com/sCCfHoS

 

then all titles are highlighted,kind of jagged dotted line surrounds them and the CSS Path is generated inside of firepath

 

I now have the code the scrape titles with http get

set(#http get,$plugin function("HTTP post.dll", "$http get", "http://www.google.com/search?q=ubot+studio", "", "", "", ""),"Global")
add list to list(%titles,$plugin function("DeliterCSS.dll", "Deliter CSS Selector", #http get, ".r>a", "TextContent"),"Delete","Global")
alert(%titles)

The out of the box tools are awesome to get 90% of what you need,for individual elements,just click copy css path usually beside a copy xpath,in the developer tools,I would still recommend learning CSS Paths so that you can write your own,its amazing stuff

 

CSS also supports wildcard selectors a useful reference page would be 

http://www.w3schools.com/cssref/css_selectors.asp

 

A wildcard would be needed for say scraping email hrefs from a page,consider this HTML

 

<a href="mailto:example@example.com">Click here to mail me!</a>

 

 

the path would be a[href^=mailto:]

a being the tag,href being an attribute of the tag,and the regex,starts with mailto:

 

 

I use and recommend pinegrow for building UI's its pretty expensive but some very nice features,you can load a URL page into pinegrow and their CSS Selector is far superior to firepath,

 

I am sure their are plenty of alternatives to firepath and better ones so if you come across one please share it

 

 

 

CSS Selector

https://1drv.ms/u/s!AgO9AudYbciJgP8ZAkIdZ6ICeNRCWQ
  • Like 3
Link to post
Share on other sites
  • 1 month later...

Hey

 

Added a scrape multi attribute feature,it returns a simle JSON object,Ayman has a free JSON Parser,

 

the point of it is so your not writing multiple lists when scrape the same element,and probably adding to table etc,saves a lot of work

 

Example,you are scraping href links and you want a seperate list of innertext of the links,you make two lists etc,especially sites with lots of data attributes you can just use this one node

load html("<a href=\"example.com1\">hi1</a>
<a href=\"example.com2\">hi2</a>
<a href=\"example.com3\">hi3</a>
")
add list to list(%data,$plugin function("DeliterCSS.dll", "Deliter CSS Selector MultiValue", $document text, "a", "href,TextContent"),"Delete","Global")
alert($plugin function("JSONpath.dll", "$JSONpath parser", $list item(%data,0), "TextContent"))

Link to post
Share on other sites
  • 2 weeks later...
  • 1 year later...

Because he had a direct download link and the link is dead I'll post the version of this plugin that I have and maybe Deliter can update his link (although he hasn't been on in a few months now)

 

https://drive.google.com/open?id=0BwVXAzqDuS_8RVcyRDA5R0FaeUU

Link to post
Share on other sites

Because he had a direct download link and the link is dead I'll post the version of this plugin that I have and maybe Deliter can update his link (although he hasn't been on in a few months now)

 

https://drive.google.com/open?id=0BwVXAzqDuS_8RVcyRDA5R0FaeUU

thank you!

Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
×
×
  • Create New...