Jump to content



Photo

Css Selector Plugin [Free]


  • Please log in to reply
8 replies to this topic

#1 deliter

deliter

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 613 posts
  • OS:Windows 8
  • Total Memory:More Than 9Gb
  • Framework:v4.0
  • License:Developer Edition

Posted 23 June 2016 - 08:21 AM

Hey

 

Ive planned on selling this but I don't have the time and too much effort so I will give it for free

 

6 functions 

 

Easy HTML Parser

CSS Selector

CSS Selector Element Offset

CSS Child Selector

CSS Sibling Selector

CSS Change Attribute

 

Its a very much needed tool so download it and learn how to use it,your scraping will be enhanced 10 fold,I am new to this too and am only scratching the surface of its power

 

Here is an example of how easy it is using firefox,with firebug and firepath plugins installed

 

say I want to scrape all the titles of a google search result

 

I simply right click over a title and select "inspect with firepath"

http://imgur.com/sCCfHoS

 

then all titles are highlighted,kind of jagged dotted line surrounds them and the CSS Path is generated inside of firepath

 

I now have the code the scrape titles with http get

set(#http get,$plugin function("HTTP post.dll", "$http get", "http://www.google.com/search?q=ubot+studio", "", "", "", ""),"Global")
add list to list(%titles,$plugin function("DeliterCSS.dll", "Deliter CSS Selector", #http get, ".r>a", "TextContent"),"Delete","Global")
alert(%titles)

The out of the box tools are awesome to get 90% of what you need,for individual elements,just click copy css path usually beside a copy xpath,in the developer tools,I would still recommend learning CSS Paths so that you can write your own,its amazing stuff

 

CSS also supports wildcard selectors a useful reference page would be 

http://www.w3schools...s_selectors.asp

 

A wildcard would be needed for say scraping email hrefs from a page,consider this HTML

 

<a href="mailto:example@example.com">Click here to mail me!</a>

 

 

the path would be a[href^='mailto:']

a being the tag,href being an attribute of the tag,and the regex,starts with mailto:

 

 

I use and recommend pinegrow for building UI's its pretty expensive but some very nice features,you can load a URL page into pinegrow and their CSS Selector is far superior to firepath,

 

I am sure their are plenty of alternatives to firepath and better ones so if you come across one please share it

 

 

 

CSS Selector

https://1drv.ms/u/s!AgO9AudYbciJgP8ZAkIdZ6ICeNRCWQ


#2 abbas786

abbas786

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 448 posts
  • OS:Windows 7
  • Total Memory:2Gb
  • Framework:v4.5+, unsure
  • License:Developer Edition

Posted 23 June 2016 - 06:38 PM

Thanks for your contribution mate.  A must have plugin along with Dan's Free Xpath Plugin


YouTube Views [ High Retention . Social Media Referrer , Suggested Video Referrer, None Geo / Geo Targeted Views ] - YouTube Video Ranking Service [ Rank Any Video Like A PRO ]   

All IN ONE - Ultimate Ubot Plugin [ Email Plugin - Datagrid Plugin - Graphical Chart Plugin - Image Processing Plugin - Video Processing Plugin - Zip / UnZip Plugin - OS Plugin - Php and Python Plugin - Cyrpto Plugin - Data Conversion Plugin - Youtube Plugin

 

Ultimate Captcha Plugin [ Solve reCaptcha NoCaptcha Within Ubot Studio -  Also Supports EX Browser using Chrome and FixFox ]


#3 deliter

deliter

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 613 posts
  • OS:Windows 8
  • Total Memory:More Than 9Gb
  • Framework:v4.0
  • License:Developer Edition

Posted 23 June 2016 - 08:36 PM

edit



#4 iamddr

iamddr

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 82 posts
  • OS:Windows 7
  • Total Memory:4Gb
  • Framework:v3.5 & v4.0
  • License:Developer Edition

Posted 24 June 2016 - 12:10 AM

Just tried this plugin, Complete product level plugin, thank you for sharing it for free.

Thank you, deliter 



#5 deliter

deliter

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 613 posts
  • OS:Windows 8
  • Total Memory:More Than 9Gb
  • Framework:v4.0
  • License:Developer Edition

Posted 03 August 2016 - 08:31 PM

Hey

 

Added a scrape multi attribute feature,it returns a simle JSON object,Ayman has a free JSON Parser,

 

the point of it is so your not writing multiple lists when scrape the same element,and probably adding to table etc,saves a lot of work

 

Example,you are scraping href links and you want a seperate list of innertext of the links,you make two lists etc,especially sites with lots of data attributes you can just use this one node

load html("<a href=\"example.com1\">hi1</a>
<a href=\"example.com2\">hi2</a>
<a href=\"example.com3\">hi3</a>
")
add list to list(%data,$plugin function("DeliterCSS.dll", "Deliter CSS Selector MultiValue", $document text, "a", "href,TextContent"),"Delete","Global")
alert($plugin function("JSONpath.dll", "$JSONpath parser", $list item(%data,0), "TextContent"))



#6 kate

kate

    Advanced Member

  • Members
  • PipPipPip
  • 35 posts
  • OS:Windows 8
  • Total Memory:< 1Gb
  • Framework:v4.5+, unsure
  • License:Developer Edition

Posted 11 August 2016 - 08:51 PM

Thank you deliter for sharing this 



#7 Eddie.Z

Eddie.Z

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 165 posts
  • OS:Windows 10
  • Total Memory:More Than 9Gb
  • Framework:v4.5+, unsure
  • License:Developer Edition

Posted 10 October 2017 - 10:29 PM

the download link do not word, is anybody have this to update the link, thanks!!



#8 HelloInsomnia

HelloInsomnia

    Advanced Member

  • Moderators
  • 3128 posts
  • OS:Windows 10
  • Total Memory:More Than 9Gb
  • Framework:v4.5+, unsure
  • License:Developer Edition

Posted 11 October 2017 - 09:55 AM

Because he had a direct download link and the link is dead I'll post the version of this plugin that I have and maybe Deliter can update his link (although he hasn't been on in a few months now)

 

https://drive.google...RVcyRDA5R0FaeUU



#9 Eddie.Z

Eddie.Z

    Advanced Member

  • Fellow UBotter
  • PipPipPip
  • 165 posts
  • OS:Windows 10
  • Total Memory:More Than 9Gb
  • Framework:v4.5+, unsure
  • License:Developer Edition

Posted 11 October 2017 - 06:56 PM

Because he had a direct download link and the link is dead I'll post the version of this plugin that I have and maybe Deliter can update his link (although he hasn't been on in a few months now)

 

https://drive.google...RVcyRDA5R0FaeUU

thank you!






0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users