[SELL] HTTP POST plugin + Crazy Bonuses Inside

[jamesfar 15]

Here's a nice reference about that:

http://www.w3schools.com/js/js_cookies.asp

 

I might be able to do a little example later.

 

Dan

 

Waiting for the examples Dan

 

Thanks b4

[Aymen 385]

HTTP Container Issue still exists with 2.5.1

 

I wrote a very simple script to show you the error.

 

I'm using your save to file method to store data.

No proxies needed in this example. It's only download some stuff from a website via http get. 

 

But I'm using an additional plugin in this example (threads counter) because local variables do not work for threading control. 

 

I'm not sure if that plugin could cause problems with http container.

BUT it's not used with the http container. 

 

I hope this helps with testing.

 

Here's a link to the threads control plugin (it's free):

http://www.ubotstudio.com/forum/index.php?/topic/15441-free-plugin-threads-counter-ubot-v4-threading-fixed/

 

 

Just in case you want to try out my example.

 

Kindest regards

Dan

 

Ok will check that out Dan,

[Bot-Factory 602]

Ok will check that out Dan,

Thanks a lot Aymen. 

 

Would be really helpful if that could be fixed. All my scrapers work great with http get.

But as soon as I need to login to a site within threads, I run into this issue. 

 

Dan

[devpro 4]

How do we download this new version. I didn't get any updates in my email. Thank you

[Aymen 385]

How do we download this new version. I didn't get any updates in my email. Thank you

PM me your email , i'll add you to the Update List!

[Bot-Factory 602]

Waiting for the examples Dan

 

Thanks b4

Here you go:

http://www.ubotstudio.com/forum/index.php?/topic/16478-http-plugin-example-move-cookies-from-browser-to-http-plugin/

[ptlrc 2]

how can i load a cookie  to current ubot browser?

 

i have followed aymen and dan's instruction, and it is nice with http plugin.

 

but when i try to  load cookie to current ubot browser, it would not work.

 

i have test in this way:

 

after login ubot forum in ubot browser manually

then run the following code

 

set(#cookie, $eval("var x = document.cookie;
x;"), "Global")
clear cookies
navigate("http://www.ubotstudio.com/forum/", "Wait")
wait for browser event("Everything Loaded", "")
wait(2)
run javascript("document.cookie=\"{#cookie}\";")
navigate("http://www.ubotstudio.com/forum/", "Wait")

 

it is not logged in when navigate ubot forum

[Bot-Factory 602]

how can i load a cookie  to current ubot browser?

 

i have followed aymen and dan's instruction, and it is nice with http plugin.

 

but when i try to  load cookie to current ubot browser, it would not work.

 

i have test in this way:

 

after login ubot forum in ubot browser manually

then run the following code

 

set(#cookie, $eval("var x = document.cookie;

x;"), "Global")

clear cookies

navigate("http://www.ubotstudio.com/forum/", "Wait")

wait for browser event("Everything Loaded", "")

wait(2)

run javascript("document.cookie=\"{#cookie}\";")

navigate("http://www.ubotstudio.com/forum/", "Wait")

 

it is not logged in when navigate ubot forum

 

That's what I said in my example post. The cookies are probably loading correctly.

The question is... Can you just use the same cookies and copy them over. Or are there additional session information's stored within those cookies. 

 

So most of the time you can't just copy it over. You need a very deep understanding about what each individual site does. And most of the time you just have to test a lot of things. 

Until you find a working solution.

 

So the error is not with the plugin or loading / saving the cookies. The error is within the cookies and WHAT you load and save. That's a big difference. 

 

Dan

[Bot-Factory 602]

Aymen,

 

are HTTPOnly cookies part of the $http cookie response string?

 

Dan

[devpro 4]

PM me your email , i'll add you to the Update List!

 

I tried to PM you Aymen but it says that you can't accept any new messages. Is your box full maybe ??

[Aymen 385]

I tried to PM you Aymen but it says that you can't accept any new messages. Is your box full maybe ??

 

Sorry about that , i cleared my inbox , you can try again!

[devpro 4]

Great thank you Aymen. 

[Bot-Factory 602]

HTTP Container Issue still exists with 2.5.1

 

I wrote a very simple script to show you the error.

 

I'm using your save to file method to store data.

No proxies needed in this example. It's only download some stuff from a website via http get. 

 

But I'm using an additional plugin in this example (threads counter) because local variables do not work for threading control. 

 

I'm not sure if that plugin could cause problems with http container.

BUT it's not used with the http container. 

 

I hope this helps with testing.

 

Here's a link to the threads control plugin (it's free):

http://www.ubotstudio.com/forum/index.php?/topic/15441-free-plugin-threads-counter-ubot-v4-threading-fixed/

 

 

Just in case you want to try out my example.

 

Kindest regards

Dan

 

Someone here who tested this as well? Is this problem happening for you as well?

 

How do you use the plugin to login to sites with multithreading successfully?

 

Dan

[Aymen 385]

Someone here who tested this as well? Is this problem happening for you as well?

 

How do you use the plugin to login to sites with multithreading successfully?

 

Dan

 

I'll make the tests on this week-end!

I'll let you know

 

Regards,

[MMD 7]

I'll make the tests on this week-end!

I'll let you know

 

Regards,

Im looking forward to it.

[Aymen 385]

Someone here who tested this as well? Is this problem happening for you as well?

 

How do you use the plugin to login to sites with multithreading successfully?

 

Dan

 

Indeed i found issues with the http container

A version will be out soon where you won't have to use the http container any more!

 

Regards,

[jamesfar 15]

Indeed i found issues with the http container

A version will be out soon where you won't have to use the http container any more!

 

Regards,

 

That will make this plugin better

[Bot-Factory 602]

Indeed i found issues with the http container

A version will be out soon where you won't have to use the http container any more!

 

Regards,

AWESOME!! Thanks a lot Aymen!!

[TBoneBot 0]

Indeed i found issues with the http container

A version will be out soon where you won't have to use the http container any more!

 

Regards,

Looking forward to that update!

[mobileconsultant 6]

Hi Aymen,

 

I just purchased, please see my skype add request, so I can get the plugin download.

 

Thanks,

Rich

[BeerNut 25]

I have run into a issue with Manta.com and Yell.com. They are both using the same captcha system now that uses reCaptcha as the captcha. The company providing the service is Distill Networks http://www.distilnetworks.com/

 

The problem is that I can not access the captcha page with HTTP Post. For example below is a URL from Yell.com

 

http://www.yell.com/distil_r_captcha.html?Ref=/biz/david-lloyd-leisure-cardiff-cardiff-901247661/&distil_RID=5453F6F6-F512-11E3-9E06-985663A08541

 

What happens is you hit the business page, then run into a 10 second meta refresh that leads to the above URL.

 

If I have HTTP Post directly try to access the above URL I get a 405 error "The remote server returned an error: (405) Method Not Allowed."

 

Has anyone figure this system out or knows how I can get around it? 

[Bot-Factory 602]

I have run into a issue with Manta.com and Yell.com. They are both using the same captcha system now that uses reCaptcha as the captcha. The company providing the service is Distill Networks http://www.distilnetworks.com/

 

The problem is that I can not access the captcha page with HTTP Post. For example below is a URL from Yell.com

 

http://www.yell.com/distil_r_captcha.html?Ref=/biz/david-lloyd-leisure-cardiff-cardiff-901247661/&distil_RID=5453F6F6-F512-11E3-9E06-985663A08541

 

What happens is you hit the business page, then run into a 10 second meta refresh that leads to the above URL.

 

If I have HTTP Post directly try to access the above URL I get a 405 error "The remote server returned an error: (405) Method Not Allowed."

 

Has anyone figure this system out or knows how I can get around it? 

 

Looks like HTTP plugin is not showing the HTML code when a 405 is returned. But 

the page always returns a 405. Even when you access that URL via a browser.

 

HTTP/1.1 405 Not Allowed

Server: nginx

Vary: User-Agent

Vary: Accept-Encoding

Content-Type: text/html

Date: Mon, 16 Jun 2014 05:55:32 GMT

Connection: keep-alive

Set-Cookie: NSC_mcw_xxx-c.zfmmhspvq.dpn_80=ffffffffc3a0420b45525d5f4f58455e445a4a421517;expires=Mon, 16-Jun-2014 06:25:32 GMT;path=/;httponly

Content-Length: 16513

 

So that looks like a http plugin limitation to me. Not sure if there is a workaround with Aymen updating the plugin to support that kind of stuff.

 

Dan

[BeerNut 25]

Yeah I discovered the 405 in browser headers after I posted this. For the moment I am using the uBot browser to load the page since that gets past this. Maybe there will be an update to allow http post to see the 405 html.

[Bot-Factory 602]

Feature Request:

 

If a webserver returns an error, it would be great if the http plugin could show the complete response. 

At the moment it looks like the plugin is stripping the response. Because I only see like error 409 and that's it. 

 

But when I look at the webserver response in fiddler there are additional informations. An XML formated API response which tells me stuff like "email address already taken". 

 

But I don't see that in ubot because http plugin doesn't return the complete string. 

 

Dan

[Bot-Factory 602]

BUG:

 

Http Plugin V2.5.1  has a bug if a cookie string is using " at the beginning and end of the cookie string.

The last " is not submitted.

 

 

Original Cookie Header (Browser)

 

 

Cookie Header via HTTP Plugin

 

 

 

This happens with Cookie Container Mode Basic and Advanced. 

And the cookie string is set correctly when I tried it with Basic mode:

 

I deleted the other cookies from the cookies string example to keep it simple in this post! In my script all of the cookies are included of course!

plugin command("HTTP post.dll", "http cookies string", "sess-at-acbde=\"pelx76AQE3MJgF424GEluR3XJmegeBqXUEcr5sWkTRk=\"")

 

 

It would be great if that could be fixed.

 

That's the reason why logins to certain sites (Amazon Buyer central) fails.

 

PM me if you need a script and login details to test it.

 

 

Thanks in advance for your help

Dan