Jump to content
UBot Underground

scrape url within page html


Recommended Posts

Hi all just started on this ubot shenanigans

 

can anyone point me in the right direction?

 

I would like to scrape a URL from a webpage

no image to scrape instead from the page code like so:

 

<area shape="rect" coords="67,4,220,45" href="

I need the link after the href=" which changes daily/weekly

 

I read about coords somewhere but for the life of me cannot find it again :|

any help would be great thanks

Link to post
Share on other sites

Hi If you can post the link that will be helpful. We can upload some sample for you.

 

thanks Kreatus

 

no link at the moment but this would be something like the html code i want to scrape

<body>

<img src="trees.gif" usemap="#green" border="0">

<map name="green">

<area shape="polygon" coords="19,44,45,11,87,37,82,76,49,98" href="http://www.trees.com/save.html">

<area shape="rect" coords="128,132,241,179" href="http://www.trees.com/furniture.html">

<area shape="circle" coords="68,211,35" href="http://www.trees.com/plantations.html">

</map>

</body>

note: the shape and coords stay the same but the link changes, not interested in anything but the url

 

 

I am sure soon as i can get my eyes on some vid tutes i will be cooking with gas, until then just have to stumble along, poke about, guess wrong and mess it up

 

any help would be awesome, thank you in advance :)

Link to post
Share on other sites

Ok... maybe something like this will work on the code http://screencast.com/t/fFufDN1qp

 

thanks Kreatus

so how do I find <area shape="rect" coords="128,132,241,179" href="HTTP://THIS URL"> which is always the same

 

in the document source code and then scrape, save and re-use later just

 

HTTP://THIS URL

 

does this make sense?

Link to post
Share on other sites

The code on that image I posted will find the content inside the " href=" and "> which is the url that you're looking for.

 

Try to insert that code in your bot and save the list. See if it fetch the urls.

excellent trying it now...thanks

Link to post
Share on other sites

excellent trying it now...thanks

 

and failed, miserably :( clueless as to how to even insert anything in anywhere in ubot

 

but anyway, good news, now at 25% of the tute videos downloaded so time for bed and fingers x'd can start on them in the morning

 

thanks again for the help Kreatus B) at least i now know what i want to do can be accomplished

Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
×
×
  • Create New...