[SELL] HTTP POST plugin + Crazy Bonuses Inside

[Bot-Factory 602]

Hi Aymen,

 

Just to be clear we don't need to use the HTTP Container command anymore?

Yes correct. He's using the thread id+ plus some magic now. To make cookies / headers unique per thread.

 

Dan

[Bot-Factory 602]

General Tip for all HTTP Plugin Users:

 

The reason why some website logins will not work for you are COOKIES. 

Via the browser it works correctly, but via http plugin it doesn't work.

 

If you compare the cookies you will see that some cookies are missing. 

 

The POST request where you send the login informations is normally correct. The webserver will send you cookie informations back.

Count them!

 

Now look at the next GET request (where you try to load the page after login). And you might see that not all cookies are there! 

 

The reason is incorrect formatting of the cookie response.

So you have to switch to Cookiecontainer BASIC Mode. And use Cookie String.

 

You can fix the output of the cookie response. 

Ideas:

replace , with ;

replace GMT  with ;

 

You can figure it out when you copy the output from cookie response and put it into cookie string. Then the server will tell you where the errors are. 

Then you have to fix them in the cookie response string.

 

I will add a new Tutorial about this issue into my HTTP plugin tutorial package (Amazon Reseller login). 

So if you have access to the training, you can take a look what I mean. 

 

Hope this helps some. 

 

PS: Aymen knows about that already. It's not really a bug in http plugin. It's more related to the underlying technilogy. Aymen might come up with a smart solution in the future. 

But for now you should know what you have to look at!

 

And if you want to see a tutorial on this. You know where you can get it.. Just saying 

 

Cheers

Dan

[Chris M 55]

So are you saying the fix is still not fixed Dan?

[Bot-Factory 602]

So are you saying the fix is still not fixed Dan?

 

Well.. the bug I reported is fixed. http plugin could not send those cookies   name=xx=123  or name="hkjhkjh8zu89"

that works fine now. 

 

But sometimes they are not sent automatically. So you have to do it manually. 

It's not really a bug. It's more a missing features :-)

 

But if you know what you have to do and how it works. Then this is absolutely no problem. 

 

The amazon video recording is finished. Editing the audio now and then I will upload it. I think that should make it very clear how that works.

 

Cheers

Dan

[Chris M 55]

Hopefully he can make it happen automatically as I am barely learning this stuff thanks to your videos

[Bot-Factory 602]

Hopefully he can make it happen automatically as I am barely learning this stuff thanks to your videos

New video is available now. It's actually not very complicated. Just something to watch for :-)

 

Cheers

Dan

[ptlrc 2]

aymen, please help me with the proxy questions

first: when i set proxy credentials , and change ip in ubot

do i still need to set proxy in http get/post

if i need to set proxy in http get/post, the format should be    ip:port:user:password?

 

second:

when i deserialize cookies,   how can i make it work with private proxy?

[Kreatus (Ubot Ninja) 422]

Aymen, Did you remove the "Clear Cookies" command? I am using that not just for http requests.

"Download File" is missing as well. It broke the bot i am currently working on.

[Aymen 385]

Aymen, Did you remove the "Clear Cookies" command? I am using that not just for http requests.

"Download File" is missing as well. It broke the bot i am currently working on.

 

For the Clear Cookies i may deleted it by mistake , i'll try to release a revised version soon , for the Download File command it was under discontinued commands so use http file download command instead!

I did say before to move away from the discontinued commands because they will be deleted in future versions !

 

 

 

aymen, please help me with the proxy questions

first: when i set proxy credentials , and change ip in ubot

do i still need to set proxy in http get/post

if i need to set proxy in http get/post, the format should be    ip:port:user:password?

 

second:

when i deserialize cookies,   how can i make it work with private proxy?

 

 

First the http post plugin takes http proxies only , second browser and http plugin are separate so setting proxies details in the browse won't change proxies details in the http post plugin , you will need to set the proxies details in the proxy input , and yes the format is ip:port:user:password !

 

Deserializing cookies have nothing to do with proxies , just set your proxies like you usually do!

[jamesfar 15]

does multithreading issues fixed in 2.5.2 Aymen?

[Bot-Factory 602]

Issues - Feature Request:

 

There is still a problem with automatic cookie "forwarding". 

When the plugin receives cookies it's not always sending all of them with the next request. 

This happens in cookiecontainer basic and advanced mode.

 

The sames cookie are also missing when I do:

http serialize cookies

http deserialize cookies

 

The cookies who are sent automatically are also used when I use http deserialize cookies. But the one that is missing is also missing when deserialize is used.

 

The only way to solve this at the moment is to switch to cookiecontainer mode basic and set the cookies manually via cookies string.

 

 

I thought that I could be just use:

plugin command("HTTP post.dll", "http cookies string", $plugin function("HTTP post.dll", "$http cookie response"))

 

But that's not working all the time. Sometimes it's not working at all. 

And sometimes the cookie string that is set is completely messed up:

 

Example:

Received cookies:

 

 

Sent cookies:

 

 

This happens when I use:

plugin command("HTTP post.dll", "http cookies string", $plugin function("HTTP post.dll", "$http cookie response"))

in Basic Mode

 

This is the related cookie response string:

c_=0x3E4FC29CFBA011E39D06A6ECC56753B2; domain=.xing.com; path=/; expires=Mon Jun 19 15:05:41 2034; HttpOnly,dtCookie=|XING|0; Path=/; Domain=.xing.com

 

For me this looks like the http plugin is understanding semicolon as a separator. 

But in this case only the comma is a separator.

 

 

But as discussed via Skype yesterday I also had a case where the cookie response was structured differently:

expires=Mon, 30-Jun-2014 21:12:14 GMTsession-id=184-7147084-8892737;

 

There the GMT was directly connected to the next cookie name.

 

So I don't know why, but the cookie response seems to be messed up a little bit. 

That's probably also the reason why the automatic "forwarding" doesn't work and deserialize  doesn't work either.

 

 

At the moment we know how to apply a workaround. But you have to extract all cookies manually and set them. Which is additional work. And something where a lot of beginners will probably fail. 

 

 

It would be really great if you could spent some time to look at this issue.

 

Thanks in advance for your support.

 

Kindest regards

Dan

 

 

 

 

 

 

 

 

 

[Bot-Factory 602]

Issues - Feature Request:

 

There is still a problem with automatic cookie "forwarding". 

When the plugin receives cookies it's not always sending all of them with the next request. 

This happens in cookiecontainer basic and advanced mode.

 

The sames cookie are also missing when I do:

http serialize cookies

http deserialize cookies

 

The cookies who are sent automatically are also used when I use http deserialize cookies. But the one that is missing is also missing when deserialize is used.

 

The only way to solve this at the moment is to switch to cookiecontainer mode basic and set the cookies manually via cookies string.

 

 

I thought that I could be just use:

plugin command("HTTP post.dll", "http cookies string", $plugin function("HTTP post.dll", "$http cookie response"))

 

But that's not working all the time. Sometimes it's not working at all. 

And sometimes the cookie string that is set is completely messed up:

 

Example:

Received cookies:

 

 

Sent cookies:

 

 

This happens when I use:

plugin command("HTTP post.dll", "http cookies string", $plugin function("HTTP post.dll", "$http cookie response"))

in Basic Mode

 

This is the related cookie response string:

c_=0x3E4FC29CFBA011E39D06A6ECC56753B2; domain=.xing.com; path=/; expires=Mon Jun 19 15:05:41 2034; HttpOnly,dtCookie=|XING|0; Path=/; Domain=.xing.com

 

For me this looks like the http plugin is understanding semicolon as a separator. 

But in this case only the comma is a separator.

 

 

But as discussed via Skype yesterday I also had a case where the cookie response was structured differently:

expires=Mon, 30-Jun-2014 21:12:14 GMTsession-id=184-7147084-8892737;

 

There the GMT was directly connected to the next cookie name.

 

So I don't know why, but the cookie response seems to be messed up a little bit. 

That's probably also the reason why the automatic "forwarding" doesn't work and deserialize  doesn't work either.

 

 

At the moment we know how to apply a workaround. But you have to extract all cookies manually and set them. Which is additional work. And something where a lot of beginners will probably fail. 

 

 

It would be really great if you could spent some time to look at this issue.

 

Thanks in advance for your support.

 

Kindest regards

Dan

 

 

 

 

 

 

 

 

 

[jamesfar 15]

 

Example:

Received cookies:

 

 

 

I wonder does the HttpOnly part of the cookies above means that the connections is from http and not from browser? Means that the admin can know if we use bots?

[Bot-Factory 602]

I wonder does the HttpOnly part of the cookies above means that the connections is from http and not from browser? Means that the admin can know if we use bots?

 

No. A http only cookies means it can not be accessed via javascript. This is a cookie security option.

 

I googled it for you 

http://en.wikipedia.org/wiki/HTTP_cookie#HttpOnly_cookie

[BeerNut 25]

Is there anyway you can fix the 405 error issue I mentioned on page 42? I am unable to load the source of a page because it always responds as a 405 error. But the same URL will display in browser. This is being used as a anti-bot protection. 

[Bot-Factory 602]

Is there anyway you can fix the 405 error issue I mentioned on page 42? I am unable to load the source of a page because it always responds as a 405 error. But the same URL will display in browser. This is being used as a anti-bot protection. 

 

It's not "fixed" in the http plugin. But there are several workarounds you could use:

 

1. Use enough and good proxy servers to avoid running into that issue in the first place

2. I have a special tutorial in my http tutorial series called "Http commands from a different angle".

This will show you a method you could use here. Because with that it's possible to load that page. But it will be some additional work because of cookies and stuff. But it's probably doable.

 

Kindest regards

Dan

[Marton 48]

-Added command http clear objects (used to collect used objects in threads to reduce memory usage , should be called just before closing a thread)

 

Hi Aymen, thanks for the update, appreciate all your work!

 

Possible bug report:

 

I added the http clear objects command at the very end of my thread. The bot was running fine before that, but now I'm getting this message every time the thread runs (multi-threaded app):

 

 

Does "should be called just before closing a thread" mean it should be the very last command in the thread? Or can I simply put it after the last http request? Here's how I've tried to use it:

 

define RUN(#current_row) {

    thread {

        in new browser {

            COMMANDS HERE...

            close page

        }

        plugin command("Advanced Ubot.dll", "threads counter", "Decrement")

        plugin command("HTTP post.dll", "http clear objects")

    }

}

 

(it's NOT a function even though there are parameters, don't let it confuse you)

 

If I delete the "http clear objects", my bot works perfectly. It's a quite complicated bot, so some of the HTTP requests don't always get called (+there are some CAPTCHA stuff where I'm using the HTTP GET/POST commands). I don't know if that's important, but I'm also using the local dictionary's thread container for the "$http captcha dialog" function in the thread somewhere:

 

plugin command("LocalDictionary.dll", "thread container") {

       set(#captcha_response, $plugin function("HTTP post.dll", "$http captcha dialog", "{$special folder("Application")}\\{#captcha_id}.jpg"), "Local")

}

[Bot-Factory 602]

This error happens if there is nothing to clear. 

So without other http commands before that command, you will get that "error". 

 

But it will only show in Ubot studio. You won't see it in a compiled bot. And it's not really an issue.

Dan

[Marton 48]

This error happens if there is nothing to clear. 

So without other http commands before that command, you will get that "error". 

 

But it will only show in Ubot studio. You won't see it in a compiled bot. And it's not really an issue.

Dan

 

I know, I'm just letting Aymen know . Hopefully a "fix" for this should be easier than adding IFs in the code every time we need to use it for complex bots where there are multiple http request commands in the same thread (and not all get used).

 

More interestingly: Just because we won't see the error in the compiled bot, all similar error handling (even if it's simply passing the erroneous code) actually slow the bot down (even if only for a split second). Not to mention some additional memory consumption when this kind of thing happens (minor, but still.. it's never a good idea to have commands that can't be executed). So in the end it can be an "issue".

 

All the best,

Marton

[earthlingj 13]

http upload isnt passing cookie string or custom headers anymore. 

 

 

actual request:

http://i.imgur.com/VBHfSXt.png

 

ubot http upload request:

http://i.imgur.com/QbCbanI.png

[Bot-Factory 602]

http upload isnt passing cookie string or custom headers anymore. 

 

 

actual request:

http://i.imgur.com/VBHfSXt.png

 

ubot http upload request:

http://i.imgur.com/QbCbanI.png

 

Did you use:

plugin command("HTTP post.dll", "http cookiecontainer mode", "Basic")

?

 

Dan

[earthlingj 13]

Did you use:

plugin command("HTTP post.dll", "http cookiecontainer mode", "Basic")

?

 

Dan

yup

[earthlingj 13]

any ETA on when http upload will be fixed? desperately need it for majority of my bots for profile image uploading and image posts. 

again, http upload function works, the problem is its not including the headers and cookie string which makes the request fail.

 

 

also getting this error on any function that has to do with a file. http file download. http upload etc:

http://prntscr.com/3x1qve

 

The functions still work, but that error pops up in studio now before it never did. 

[Aymen 385]

i'll fix all the issues in the next update which will be released in at least 15 days from now!

 

Regards

[mr.kim8692 2]

i'll fix all the issues in the next update which will be released in at least 15 days from now!

 

Regards

Hi buddy, I just purchased and sent you a pm, check your inbox