Reading the HTTP header?

[Anonym 53]

Does anyone know if there is a possibility to parse/read the HTTP header for the document that is already read? I do not want to ask the webserver again, because what I am looking for might have been altered.

[JohnB 255]

I have no idea what you want to do or your ultimate goal, but you can read view the headers via a web app like so:

 

clear table(&header)

ui text box("URL to Check", #url)

in new browser {

set visibility("Invisible")

navigate("http://www.webconfs.com/http-header-check.php", "Wait")

type text(<url field>, #url, "Standard")

click(<type="submit">, "Left Click", "No")

wait(3)

scrape table(<outerhtml=w"<table width=\"100%\" bgcolor=\"#F3F3F3\" cellspacing=\"15\"><tbody><tr><td> <table border=\"0\">

<tbody><tr>

<td>

<font class=\"defaultfont\"><b>*</b> =&gt; <br></font>

*

</tr>

</tbody></table>

</td></tr></tbody></table>">, &header)

}

load html(&header)

John

[Anonym 53]

My current client, an e-commerce company, are having problems with the generation of canonical URLs. Sometimes they are generated as they should and sometimes not. I think (!) that this is related to the webfronts (four servers) and my plan is to make a substantial amount of calls to the webserver to gather statistics.

In the HTTP header there is information about which webfront is the one that answered. I need that information to see if I can find a pattern in the erronous generation of canonical URLs.

[Anonym 53]

Thanks John,

 

that was actually a very cool service.

 

Thanks!

[JohnB 255]

Cool...I can't think of another method to achieve what you need...

 

 

John

[Anonym 53]

That service was really good and in fact I found an even better one that also shows the page, not just the header.

Here it is: http://web-sniffer.net/

[rusty 0]

May I ask on what you are trying to achieve on this? Try Wireshark(Open Source). It's a good TCP dump as well.

[Anonym 53]

Of course you may.

 

It's all here: http://ubotstudio.com/forum/index.php?/topic/9266-reading-the-http-header/page__view__findpost__p__47322

 

So I want BOTH the page and the page header.

 

As far as I know, WireShark would not have solved this.

[Bob The Builder 62]

I have no idea what you want to do or your ultimate goal, but you can read view the headers via a web app like so:

 

clear table(&header)

ui text box("URL to Check", #url)

in new browser {

set visibility("Invisible")

navigate("http://www.webconfs.com/http-header-check.php", "Wait")

type text(<url field>, #url, "Standard")

click(<type="submit">, "Left Click", "No")

wait(3)

scrape table(<outerhtml=w"<table width=\"100%\" bgcolor=\"#F3F3F3\" cellspacing=\"15\"><tbody><tr><td> <table border=\"0\">

<tbody><tr>

<td>

<font class=\"defaultfont\"><b>*</b> => <br></font>

*

</tr>

</tbody></table>

</td></tr></tbody></table>">, &header)

}

load html(&header)

 

 

 

 

John

 

I wanted this functionality as well. A good example is testing proxies. As ubot has no tools to do this, the common way is to use a proxy judge script which reports results via headers. Since it responds to your ip you can't use a service like you mentioned to do this.

 

It would be a nice feature but I much rather see ubot add tools to test proxies. This is desperately required and is done very well in Zenno.

 

I need to test the following:

 

Works/doesn't work

Banned from Google

Response time

Country or origin

Anonymous level and ip leakage

Is codeen/planetlab