jamesfar 15 Posted June 3, 2014 Report Share Posted June 3, 2014 Here's a nice reference about that:http://www.w3schools.com/js/js_cookies.asp I might be able to do a little example later. Dan Waiting for the examples Dan Thanks b4 Quote Link to post Share on other sites
Aymen 385 Posted June 3, 2014 Author Report Share Posted June 3, 2014 HTTP Container Issue still exists with 2.5.1 I wrote a very simple script to show you the error. I'm using your save to file method to store data.No proxies needed in this example. It's only download some stuff from a website via http get. But I'm using an additional plugin in this example (threads counter) because local variables do not work for threading control. I'm not sure if that plugin could cause problems with http container.BUT it's not used with the http container. I hope this helps with testing. Here's a link to the threads control plugin (it's free):http://www.ubotstudio.com/forum/index.php?/topic/15441-free-plugin-threads-counter-ubot-v4-threading-fixed/ Just in case you want to try out my example. Kindest regardsDan Ok will check that out Dan, 1 Quote Link to post Share on other sites
Bot-Factory 602 Posted June 3, 2014 Report Share Posted June 3, 2014 Ok will check that out Dan,Thanks a lot Aymen. Would be really helpful if that could be fixed. All my scrapers work great with http get.But as soon as I need to login to a site within threads, I run into this issue. Dan Quote Link to post Share on other sites
devpro 4 Posted June 3, 2014 Report Share Posted June 3, 2014 How do we download this new version. I didn't get any updates in my email. Thank you Quote Link to post Share on other sites
Aymen 385 Posted June 3, 2014 Author Report Share Posted June 3, 2014 How do we download this new version. I didn't get any updates in my email. Thank youPM me your email , i'll add you to the Update List! Quote Link to post Share on other sites
Bot-Factory 602 Posted June 3, 2014 Report Share Posted June 3, 2014 Waiting for the examples Dan Thanks b4Here you go:http://www.ubotstudio.com/forum/index.php?/topic/16478-http-plugin-example-move-cookies-from-browser-to-http-plugin/ 1 Quote Link to post Share on other sites
ptlrc 2 Posted June 4, 2014 Report Share Posted June 4, 2014 how can i load a cookie to current ubot browser? i have followed aymen and dan's instruction, and it is nice with http plugin. but when i try to load cookie to current ubot browser, it would not work. i have test in this way: after login ubot forum in ubot browser manuallythen run the following code set(#cookie, $eval("var x = document.cookie;x;"), "Global")clear cookiesnavigate("http://www.ubotstudio.com/forum/", "Wait")wait for browser event("Everything Loaded", "")wait(2)run javascript("document.cookie=\"{#cookie}\";")navigate("http://www.ubotstudio.com/forum/", "Wait") it is not logged in when navigate ubot forum Quote Link to post Share on other sites
Bot-Factory 602 Posted June 4, 2014 Report Share Posted June 4, 2014 how can i load a cookie to current ubot browser? i have followed aymen and dan's instruction, and it is nice with http plugin. but when i try to load cookie to current ubot browser, it would not work. i have test in this way: after login ubot forum in ubot browser manuallythen run the following code set(#cookie, $eval("var x = document.cookie;x;"), "Global")clear cookiesnavigate("http://www.ubotstudio.com/forum/", "Wait")wait for browser event("Everything Loaded", "")wait(2)run javascript("document.cookie=\"{#cookie}\";")navigate("http://www.ubotstudio.com/forum/", "Wait") it is not logged in when navigate ubot forum That's what I said in my example post. The cookies are probably loading correctly.The question is... Can you just use the same cookies and copy them over. Or are there additional session information's stored within those cookies. So most of the time you can't just copy it over. You need a very deep understanding about what each individual site does. And most of the time you just have to test a lot of things. Until you find a working solution. So the error is not with the plugin or loading / saving the cookies. The error is within the cookies and WHAT you load and save. That's a big difference. Dan Quote Link to post Share on other sites
Bot-Factory 602 Posted June 4, 2014 Report Share Posted June 4, 2014 Aymen, are HTTPOnly cookies part of the $http cookie response string? Dan Quote Link to post Share on other sites
devpro 4 Posted June 4, 2014 Report Share Posted June 4, 2014 PM me your email , i'll add you to the Update List! I tried to PM you Aymen but it says that you can't accept any new messages. Is your box full maybe ?? Quote Link to post Share on other sites
Aymen 385 Posted June 4, 2014 Author Report Share Posted June 4, 2014 I tried to PM you Aymen but it says that you can't accept any new messages. Is your box full maybe ?? Sorry about that , i cleared my inbox , you can try again! Quote Link to post Share on other sites
devpro 4 Posted June 5, 2014 Report Share Posted June 5, 2014 Great thank you Aymen. Quote Link to post Share on other sites
Bot-Factory 602 Posted June 5, 2014 Report Share Posted June 5, 2014 HTTP Container Issue still exists with 2.5.1 I wrote a very simple script to show you the error. I'm using your save to file method to store data.No proxies needed in this example. It's only download some stuff from a website via http get. But I'm using an additional plugin in this example (threads counter) because local variables do not work for threading control. I'm not sure if that plugin could cause problems with http container.BUT it's not used with the http container. I hope this helps with testing. Here's a link to the threads control plugin (it's free):http://www.ubotstudio.com/forum/index.php?/topic/15441-free-plugin-threads-counter-ubot-v4-threading-fixed/ Just in case you want to try out my example. Kindest regardsDan Someone here who tested this as well? Is this problem happening for you as well? How do you use the plugin to login to sites with multithreading successfully? Dan Quote Link to post Share on other sites
Aymen 385 Posted June 5, 2014 Author Report Share Posted June 5, 2014 Someone here who tested this as well? Is this problem happening for you as well? How do you use the plugin to login to sites with multithreading successfully? Dan I'll make the tests on this week-end!I'll let you know Regards, Quote Link to post Share on other sites
MMD 7 Posted June 7, 2014 Report Share Posted June 7, 2014 I'll make the tests on this week-end!I'll let you know Regards,Im looking forward to it. Quote Link to post Share on other sites
Aymen 385 Posted June 7, 2014 Author Report Share Posted June 7, 2014 Someone here who tested this as well? Is this problem happening for you as well? How do you use the plugin to login to sites with multithreading successfully? Dan Indeed i found issues with the http containerA version will be out soon where you won't have to use the http container any more! Regards, 1 Quote Link to post Share on other sites
jamesfar 15 Posted June 7, 2014 Report Share Posted June 7, 2014 Indeed i found issues with the http containerA version will be out soon where you won't have to use the http container any more! Regards, That will make this plugin better Quote Link to post Share on other sites
Bot-Factory 602 Posted June 7, 2014 Report Share Posted June 7, 2014 Indeed i found issues with the http containerA version will be out soon where you won't have to use the http container any more! Regards,AWESOME!! Thanks a lot Aymen!! Quote Link to post Share on other sites
TBoneBot 0 Posted June 11, 2014 Report Share Posted June 11, 2014 Indeed i found issues with the http containerA version will be out soon where you won't have to use the http container any more! Regards,Looking forward to that update! Quote Link to post Share on other sites
mobileconsultant 6 Posted June 12, 2014 Report Share Posted June 12, 2014 Hi Aymen, I just purchased, please see my skype add request, so I can get the plugin download. Thanks,Rich Quote Link to post Share on other sites
BeerNut 25 Posted June 16, 2014 Report Share Posted June 16, 2014 I have run into a issue with Manta.com and Yell.com. They are both using the same captcha system now that uses reCaptcha as the captcha. The company providing the service is Distill Networks http://www.distilnetworks.com/ The problem is that I can not access the captcha page with HTTP Post. For example below is a URL from Yell.com http://www.yell.com/distil_r_captcha.html?Ref=/biz/david-lloyd-leisure-cardiff-cardiff-901247661/&distil_RID=5453F6F6-F512-11E3-9E06-985663A08541 What happens is you hit the business page, then run into a 10 second meta refresh that leads to the above URL. If I have HTTP Post directly try to access the above URL I get a 405 error "The remote server returned an error: (405) Method Not Allowed." Has anyone figure this system out or knows how I can get around it? Quote Link to post Share on other sites
Bot-Factory 602 Posted June 16, 2014 Report Share Posted June 16, 2014 I have run into a issue with Manta.com and Yell.com. They are both using the same captcha system now that uses reCaptcha as the captcha. The company providing the service is Distill Networks http://www.distilnetworks.com/ The problem is that I can not access the captcha page with HTTP Post. For example below is a URL from Yell.com http://www.yell.com/distil_r_captcha.html?Ref=/biz/david-lloyd-leisure-cardiff-cardiff-901247661/&distil_RID=5453F6F6-F512-11E3-9E06-985663A08541 What happens is you hit the business page, then run into a 10 second meta refresh that leads to the above URL. If I have HTTP Post directly try to access the above URL I get a 405 error "The remote server returned an error: (405) Method Not Allowed." Has anyone figure this system out or knows how I can get around it? Looks like HTTP plugin is not showing the HTML code when a 405 is returned. But the page always returns a 405. Even when you access that URL via a browser. HTTP/1.1 405 Not AllowedServer: nginxVary: User-AgentVary: Accept-EncodingContent-Type: text/htmlDate: Mon, 16 Jun 2014 05:55:32 GMTConnection: keep-aliveSet-Cookie: NSC_mcw_xxx-c.zfmmhspvq.dpn_80=ffffffffc3a0420b45525d5f4f58455e445a4a421517;expires=Mon, 16-Jun-2014 06:25:32 GMT;path=/;httponlyContent-Length: 16513 So that looks like a http plugin limitation to me. Not sure if there is a workaround with Aymen updating the plugin to support that kind of stuff. Dan Quote Link to post Share on other sites
BeerNut 25 Posted June 16, 2014 Report Share Posted June 16, 2014 Yeah I discovered the 405 in browser headers after I posted this. For the moment I am using the uBot browser to load the page since that gets past this. Maybe there will be an update to allow http post to see the 405 html. Quote Link to post Share on other sites
Bot-Factory 602 Posted June 17, 2014 Report Share Posted June 17, 2014 Feature Request: If a webserver returns an error, it would be great if the http plugin could show the complete response. At the moment it looks like the plugin is stripping the response. Because I only see like error 409 and that's it. But when I look at the webserver response in fiddler there are additional informations. An XML formated API response which tells me stuff like "email address already taken". But I don't see that in ubot because http plugin doesn't return the complete string. Dan Quote Link to post Share on other sites
Bot-Factory 602 Posted June 18, 2014 Report Share Posted June 18, 2014 BUG: Http Plugin V2.5.1 has a bug if a cookie string is using " at the beginning and end of the cookie string.The last " is not submitted. Original Cookie Header (Browser) Cookie Header via HTTP Plugin This happens with Cookie Container Mode Basic and Advanced. And the cookie string is set correctly when I tried it with Basic mode: I deleted the other cookies from the cookies string example to keep it simple in this post! In my script all of the cookies are included of course!plugin command("HTTP post.dll", "http cookies string", "sess-at-acbde=\"pelx76AQE3MJgF424GEluR3XJmegeBqXUEcr5sWkTRk=\"") It would be great if that could be fixed. That's the reason why logins to certain sites (Amazon Buyer central) fails. PM me if you need a script and login details to test it. Thanks in advance for your helpDan Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.