Jump to content
UBot Underground

How To Scrap A Webpage And Add To A Table


Recommended Posts

Hi there,

I am new to Ubot and I am trying to do what I thought was a simple thing...but I cannot figure out how to do it:

 

here is the webpage I am looking at: http://www.ceres.org/investor-network/incr/member-directory

I need to get a table wit the following data:

- url of the member (it is 'under' the logo image, but sometimes it is not available)

- name of the organization

- text description

 

I succeeded in getting in a list either one of these three elements, but I need to get all of them in a table.

 

Any help would be greatly appreciated.

 

 

Link to post
Share on other sites

Try.

add item to list(%name,"Name","Delete","Global")
add item to list(%url,"Url","Delete","Global")
add item to list(%des,"Des","Delete","Global")
add list to list(%name,$scrape attribute(<tagname="h3">,"innertext"),"Delete","Global")
add list to list(%url,$scrape attribute(<tagname="h3">,"innerhtml"),"Delete","Global")
plugin command("Advanced Data Text File.dll", "list replace (regex)", %url, "(<a.*?\"|\">.*)", "", "True")
add list to list(%des,$scrape attribute(<class="listing-text">,"innertext"),"Delete","Global")
plugin command("Advanced Data Text File.dll", "table insert by list", &report, %name, "Col", 0)
plugin command("Advanced Data Text File.dll", "table insert by list", &report, %url, "Col", 1)
plugin command("Advanced Data Text File.dll", "table insert by list", &report, %des, "Col", 2)
Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
×
×
  • Create New...