Aymen 385 Posted April 4, 2014 Author Report Share Posted April 4, 2014 one doubt. Your plugin doesnt need to navigate to anything as it just sends a request and gets a requestFrom the ubot socket commands i see *socket NAVIGATE* does that mean your plugin is better? I mean i can already do some sort of things with the sockets like scraping faster , posting things and blablabla but what exactly this plugin will add to me? thanks they just named the command to be similar to the browser ones and to be newbie friendly!as i said the difference is that my plugin is much more advanced (ask everyone who actually uses it) , it takes you deep in http requests!And also people were using it way way before sockets commands from Ubot were introduced! Quote Link to post Share on other sites
Bot-Factory 602 Posted April 4, 2014 Report Share Posted April 4, 2014 one doubt. Your plugin doesnt need to navigate to anything as it just sends a request and gets a requestFrom the ubot socket commands i see *socket NAVIGATE* does that mean your plugin is better? I mean i can already do some sort of things with the sockets like scraping faster , posting things and blablabla but what exactly this plugin will add to me? thanks Kardoser, you can do the basic HTTP stuff with the sockets plugin from Ubot directly. But when it comes to more advanced stuff, you need the HTTP Post plugin because it has a lot more features. So if you are new to this http world and your budget is limited, learn the basic stuff with sockets first. But sooner or later you find find some unsolvable problems. And then you have to look into Aymens plugin. If you can afford the $77, then you should start with his plugin directly. Because the documentation and the source code will speedup your learning curve a lot. And it's definitely not wasted because it can doll a hell lot more than the basic sockets plugin that comes with Ubot. Hope that helps a little bit.Dan Quote Link to post Share on other sites
runsoftware 14 Posted April 4, 2014 Report Share Posted April 4, 2014 (edited) Your payment gateway is not accepting paypal for me... Can you pm your paypal email for me? Edited April 4, 2014 by KardoseR Quote Link to post Share on other sites
Aymen 385 Posted April 4, 2014 Author Report Share Posted April 4, 2014 Your payment gateway is not accepting paypal for me... Can you pm your paypal email for me? Yes it does accept paypal Quote Link to post Share on other sites
Bot-Factory 602 Posted April 9, 2014 Report Share Posted April 9, 2014 I'm looking for an OAuth 2,0 example. If someone has done that, I'm very interested to see your source code. I'm open to pay for that as well. PM me please if you want to discuss some personal arrangements. Thanks in advance for your helpDan Quote Link to post Share on other sites
rapt0r 3 Posted April 10, 2014 Report Share Posted April 10, 2014 I am interested in purchasing this plugin. I have some questions.1. Is there a way to save cookies and then use those cookies with the browser?2. Is it possible to use the browser to login to a site then have the rest of the stuff done via requests?3. Anyone made any youtube bots that log into accounts using this plugin? or it's not possible because of their high security? Quote Link to post Share on other sites
Aymen 385 Posted April 10, 2014 Author Report Share Posted April 10, 2014 I am interested in purchasing this plugin. I have some questions. 1. Is there a way to save cookies and then use those cookies with the browser?2. Is it possible to use the browser to login to a site then have the rest of the stuff done via requests?3. Anyone made any youtube bots that log into accounts using this plugin? or it's not possible because of their high security? 1-there is multiple ways to save cookies and use them again in other http requests , but i'm afraid ubot browser won't allow you to set cookies2-possible with some sites , and won't work on some other!3-youtube bots are possible ! don't have any available for now but i have plans to make one in the near future Quote Link to post Share on other sites
Bot-Factory 602 Posted April 11, 2014 Report Share Posted April 11, 2014 Feature Request: Would it be possible for the "xpath parser"to move the "attribute to get" into the Xpath expression? So that I can specify the attribute the regular way with :href or :InnerText Reason:I want to put the xpath parser into a define and send my URLs and expression to the define. And get the data via a return. But at the moment I have to split the xpath expression because the function has two separate values. Expression and "attribute to get" Thanks for considering this for the future.Dan Quote Link to post Share on other sites
Aymen 385 Posted April 12, 2014 Author Report Share Posted April 12, 2014 Hey Dan , that will make it harder to use!You could write a function that does the splitting for you , couple of more lines of code but gets the job done ! Quote Link to post Share on other sites
Bot-Factory 602 Posted April 12, 2014 Report Share Posted April 12, 2014 Hey Dan , that will make it harder to use!You could write a function that does the splitting for you , couple of more lines of code but gets the job done !Yeah you are right.After I thought about it for a while I came to the same conclusion. I wrote two defines who are able to extract the data: Maybe helpful for someone:define $ExtractData(#url, #xpath, #attribute) { set(#result, $plugin function("HTTP post.dll", "$http get", #url, $plugin function("HTTP post.dll", "$http useragent string", "Chrome 32.0 Win7 64-bit"), "", "", ""), "Local") set(#tmp2, $plugin function("HTTP post.dll", "$xpath parser", #result, #xpath, #attribute, "HTML"), "Local") return(#tmp2)}define $ExtractDataFirst(#url, #xpath, #attribute) { set(#result, $plugin function("HTTP post.dll", "$http get", #url, $plugin function("HTTP post.dll", "$http useragent string", "Chrome 32.0 Win7 64-bit"), "", "", ""), "Local") set(#tmp2, $plugin function("HTTP post.dll", "$xpath parser index", #result, #xpath, 0, #attribute), "Local") return(#tmp2)} Dan Quote Link to post Share on other sites
Marton 48 Posted April 12, 2014 Report Share Posted April 12, 2014 Yeah you are right.After I thought about it for a while I came to the same conclusion. I wrote two defines who are able to extract the data: Maybe helpful for someone:define $ExtractData(#url, #xpath, #attribute) { set(#result, $plugin function("HTTP post.dll", "$http get", #url, $plugin function("HTTP post.dll", "$http useragent string", "Chrome 32.0 Win7 64-bit"), "", "", ""), "Local") set(#tmp2, $plugin function("HTTP post.dll", "$xpath parser", #result, #xpath, #attribute, "HTML"), "Local") return(#tmp2)}define $ExtractDataFirst(#url, #xpath, #attribute) { set(#result, $plugin function("HTTP post.dll", "$http get", #url, $plugin function("HTTP post.dll", "$http useragent string", "Chrome 32.0 Win7 64-bit"), "", "", ""), "Local") set(#tmp2, $plugin function("HTTP post.dll", "$xpath parser index", #result, #xpath, 0, #attribute), "Local") return(#tmp2)} DanAre you sure "Chrome 32.0 Win7 64-bit" is a valid user agent string? Or is this how we have to use it with HTTP requests? I thought it should be something like: Mozilla/5.0 (Windows NT 6.2; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/32.0.1667.0 Safari/537.36 Thanks for your help,Marton Quote Link to post Share on other sites
Bot-Factory 602 Posted April 12, 2014 Report Share Posted April 12, 2014 Are you sure "Chrome 32.0 Win7 64-bit" is a valid user agent string? Or is this how we have to use it with HTTP requests? I thought it should be something like: Mozilla/5.0 (Windows NT 6.2; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/32.0.1667.0 Safari/537.36 Thanks for your help,MartonThat's not the string itself Marton. The HTTP plugin has a function called "$http useragent string" and there you configure "Chrome32.0 ..." and the function converts that to the correct user agent string. So that you don't have to enter the whole thing on your own. But of course. You don't have to use that function. You can set the user agent manually as well. Dan 1 Quote Link to post Share on other sites
Marton 48 Posted April 12, 2014 Report Share Posted April 12, 2014 That's not the string itself Marton. The HTTP plugin has a function called "$http useragent string" and there you configure "Chrome32.0 ..." and the function converts that to the correct user agent string. So that you don't have to enter the whole thing on your own. But of course. You don't have to use that function. You can set the user agent manually as well. Dan Got it, thanks Dan! Quote Link to post Share on other sites
Bot-Factory 602 Posted April 13, 2014 Report Share Posted April 13, 2014 I'm not able to get "$http last response" to work: plugin command("HTTP post.dll", "http auto redirect", "Yes")plugin command("HTTP post.dll", "http max redirects", 10)set(#test, $plugin function("HTTP post.dll", "$http get", "http://www.google.com", $plugin function("HTTP post.dll", "$http useragent string", "Chrome 32.0 MacOSX"), "", "", ""), "Global")set(#test2, $plugin function("HTTP post.dll", "$http last response"), "Global") Http last response always contains some strange stuff. But shouldn't it be #test = #test2 ?? Dan Quote Link to post Share on other sites
Aymen 385 Posted April 18, 2014 Author Report Share Posted April 18, 2014 I'm not able to get "$http last response" to work: plugin command("HTTP post.dll", "http auto redirect", "Yes")plugin command("HTTP post.dll", "http max redirects", 10)set(#test, $plugin function("HTTP post.dll", "$http get", "http://www.google.com", $plugin function("HTTP post.dll", "$http useragent string", "Chrome 32.0 MacOSX"), "", "", ""), "Global")set(#test2, $plugin function("HTTP post.dll", "$http last response"), "Global") Http last response always contains some strange stuff. But shouldn't it be #test = #test2 ?? Dan If you are intending to use $http last response , make sure everything is inside a http container Quote Link to post Share on other sites
jamesfar 15 Posted April 20, 2014 Report Share Posted April 20, 2014 Hi Aymen, Got few questions : 1. If i have this cookies from fiddler : Referer: http://www.cbengine.com/index.cfm Cookie: CFID=94003099; CFTOKEN=e0d45939e0e2250d-B8E98FB5-D4AE-5286-40390C5C7C88D0C9; CFCLIENT_CBENGINE=cbengine%5Fuseruc%3DF87AEB86%2DD4AE%2D5286%2D4039A00F9D665CF5%23; CFGLOBALS=urltoken%3DCFID%23%3D94003099%26CFTOKEN%23%3De0d45939e0e2250d%2DB8E98FB5%2DD4AE%2D5286%2D40390C5C7C88D0C9%23lastvisit%3D%7Bts%20%272014%2D04%2D20%2006%3A07%3A31%27%7D%23timecreated%3D%7Bts%20%272014%2D04%2D19%2000%3A29%3A54%27%7D%23hitcount%3D61%23cftoken%3De0d45939e0e2250d%2DB8E98FB5%2DD4AE%2D5286%2D40390C5C7C88D0C9%23cfid%3D94003099%23; __utma=52897530.751642508.1397892609.1397966449.1397999214.8; __utmc=52897530; __utmz=52897530.1397892609.1.1.utmcsr=google|utmccn=(organic)|utmcmd=organic|utmctr=(not%20provided); cbe_catmetrics=1; __utmb=52897530.4.10.1397999218; CBENGINE_USERUC=F87AEB86%2DD4AE%2D5286%2D4039A00F9D665CF5 Connection: keep-alive Which one should i put on "http cookies string" command? 2. "http cookies string" command works almost the same like serialize and deserialize cookie command? the purpose is to reuse the same session. Am i right? 3. What is "http cookiecontainer mode" command do? Please help Quote Link to post Share on other sites
Aymen 385 Posted April 20, 2014 Author Report Share Posted April 20, 2014 Hi Aymen, Got few questions : 1. If i have this cookies from fiddler : Referer: http://www.cbengine.com/index.cfm Cookie: CFID=94003099; CFTOKEN=e0d45939e0e2250d-B8E98FB5-D4AE-5286-40390C5C7C88D0C9; CFCLIENT_CBENGINE=cbengine%5Fuseruc%3DF87AEB86%2DD4AE%2D5286%2D4039A00F9D665CF5%23; CFGLOBALS=urltoken%3DCFID%23%3D94003099%26CFTOKEN%23%3De0d45939e0e2250d%2DB8E98FB5%2DD4AE%2D5286%2D40390C5C7C88D0C9%23lastvisit%3D%7Bts%20%272014%2D04%2D20%2006%3A07%3A31%27%7D%23timecreated%3D%7Bts%20%272014%2D04%2D19%2000%3A29%3A54%27%7D%23hitcount%3D61%23cftoken%3De0d45939e0e2250d%2DB8E98FB5%2DD4AE%2D5286%2D40390C5C7C88D0C9%23cfid%3D94003099%23; __utma=52897530.751642508.1397892609.1397966449.1397999214.8; __utmc=52897530; __utmz=52897530.1397892609.1.1.utmcsr=google|utmccn=(organic)|utmcmd=organic|utmctr=(not%20provided); cbe_catmetrics=1; __utmb=52897530.4.10.1397999218; CBENGINE_USERUC=F87AEB86%2DD4AE%2D5286%2D4039A00F9D665CF5 Connection: keep-alive Which one should i put on "http cookies string" command? 2. "http cookies string" command works almost the same like serialize and deserialize cookie command? the purpose is to reuse the same session. Am i right? 3. What is "http cookiecontainer mode" command do? Please help yes http cookies string works the same the only difference is that you can type the cookies string yourself!There is some cases where some sites will use extensive redirects which cause the session to break and the cookies doesn't get sent properly , with this you can disable redirects and use this command to send cookies manually and managing redirections manually too And about the http cookiecontainer mode , its still in beta so when i finish testing i'll let everyone know what it does exactly Quote Link to post Share on other sites
jamesfar 15 Posted April 21, 2014 Report Share Posted April 21, 2014 yes http cookies string works the same the only difference is that you can type the cookies string yourself!There is some cases where some sites will use extensive redirects which cause the session to break and the cookies doesn't get sent properly , with this you can disable redirects and use this command to send cookies manually and managing redirections manually too And about the http cookiecontainer mode , its still in beta so when i finish testing i'll let everyone know what it does exactly Thanks for answering Aymen, So based on my situation which line is the cookie that i have to add to "http cookies string" command? Is it all of this one : CFID=94003099; CFTOKEN=e0d45939e0e2250d-B8E98FB5-D4AE-5286-40390C5C7C88D0C9; CFCLIENT_CBENGINE=cbengine%5Fuseruc%3DF87AEB86%2DD4AE%2D5286%2D4039A00F9D665CF5%23; CFGLOBALS=urltoken%3DCFID%23%3D94003099%26CFTOKEN%23%3De0d45939e0e2250d%2DB8E98FB5%2DD4AE%2D5286%2D40390C5C7C88D0C9%23lastvisit%3D%7Bts%20%272014%2D04%2D20%2006%3A07%3A31%27%7D%23timecreated%3D%7Bts%20%272014%2D04%2D19%2000%3A29%3A54%27%7D%23hitcount%3D61%23cftoken%3De0d45939e0e2250d%2DB8E98FB5%2DD4AE%2D5286%2D40390C5C7C88D0C9%23cfid%3D94003099%23; __utma=52897530.751642508.1397892609.1397966449.1397999214.8; __utmc=52897530; __utmz=52897530.1397892609.1.1.utmcsr=google|utmccn=(organic)|utmcmd=organic|utmctr=(not%20provided); cbe_catmetrics=1; __utmb=52897530.4.10.1397999218; CBENGINE_USERUC=F87AEB86%2DD4AE%2D5286%2D4039A00F9D665CF5 ? And where should i placed this "http cookies string" command? before every get/post? or just once on the top of the http thread container? How to disabled redirect and manage it manually? Please help Quote Link to post Share on other sites
Aymen 385 Posted April 21, 2014 Author Report Share Posted April 21, 2014 Thanks for answering Aymen, So based on my situation which line is the cookie that i have to add to "http cookies string" command? Is it all of this one : CFID=94003099; CFTOKEN=e0d45939e0e2250d-B8E98FB5-D4AE-5286-40390C5C7C88D0C9; CFCLIENT_CBENGINE=cbengine%5Fuseruc%3DF87AEB86%2DD4AE%2D5286%2D4039A00F9D665CF5%23; CFGLOBALS=urltoken%3DCFID%23%3D94003099%26CFTOKEN%23%3De0d45939e0e2250d%2DB8E98FB5%2DD4AE%2D5286%2D40390C5C7C88D0C9%23lastvisit%3D%7Bts%20%272014%2D04%2D20%2006%3A07%3A31%27%7D%23timecreated%3D%7Bts%20%272014%2D04%2D19%2000%3A29%3A54%27%7D%23hitcount%3D61%23cftoken%3De0d45939e0e2250d%2DB8E98FB5%2DD4AE%2D5286%2D40390C5C7C88D0C9%23cfid%3D94003099%23; __utma=52897530.751642508.1397892609.1397966449.1397999214.8; __utmc=52897530; __utmz=52897530.1397892609.1.1.utmcsr=google|utmccn=(organic)|utmcmd=organic|utmctr=(not%20provided); cbe_catmetrics=1; __utmb=52897530.4.10.1397999218; CBENGINE_USERUC=F87AEB86%2DD4AE%2D5286%2D4039A00F9D665CF5 ? And where should i placed this "http cookies string" command? before every get/post? or just once on the top of the http thread container? How to disabled redirect and manage it manually? Please help yes you use http cookies string before get/posti'll try to make a small source code example Quote Link to post Share on other sites
Bot-Factory 602 Posted April 23, 2014 Report Share Posted April 23, 2014 Hello. Is there a way to support UTF-8 with HTTP get?Instead of umlauts like ÖÄÜß i'm getting strange stuff like üI tried to play around withplugin command("HTTP post.dll", "http accept charset", "UTF-8")but that didn't work.Thanks in advance for your helpDan SOLVED:plugin command("HTTP post.dll", "http set encoding", "UTF8") Did the trick. Thanks Aymen! Quote Link to post Share on other sites
Aymen 385 Posted April 26, 2014 Author Report Share Posted April 26, 2014 Update (2.5.0): -added a http cookie response function to return cookies header (used inside a http container)-fixed http captcha dialog not releasing image from memory after closing dialog -Added Linkfinder function to get links from the latest response html document (used inside a http container)-Made http response headers function thread safe (same as http last response) (used inside a http container) -Fixed basic mode returning "handshare failed due to an enexpected packet format" 3 Quote Link to post Share on other sites
Bot-Factory 602 Posted April 27, 2014 Report Share Posted April 27, 2014 Hello Aymen, Version 2.5 still is not able to do http get for URLs who have a "." Example:https://www.xing.com/de/directories/people/c/c./ It gives a 404 all the time. Dan Quote Link to post Share on other sites
Aymen 385 Posted April 27, 2014 Author Report Share Posted April 27, 2014 Hello Aymen, Version 2.5 still is not able to do http get for URLs who have a "." Example:https://www.xing.com/de/directories/people/c/c./ It gives a 404 all the time. Dan Ok i will look into it next update Quote Link to post Share on other sites
Marton 48 Posted April 27, 2014 Report Share Posted April 27, 2014 Update (2.5.0): -added a http cookie response function to return cookies header (used inside a http container) -fixed http captcha dialog not releasing image from memory after closing dialog -Added Linkfinder function to get links from the latest response html document (used inside a http container) -Made http response headers function thread safe (same as http last response) (used inside a http container) -Fixed basic mode returning "handshare failed due to an enexpected packet format"Hey Aymen, thanks so much for not forgetting about the CAPTCHA dialog issue. I tested it and it's working perfectly! Thanks again & all the best,Marton Quote Link to post Share on other sites
orbital 15 Posted April 27, 2014 Report Share Posted April 27, 2014 How do you get the right captcha image when the captcha image doesn't have a unique identifier and is just generated by server side code like http://www.ereaderiq.com/contact/ of course, everytime I do a http file download I get a different image. I did notice there is a bit of javascript it does on the end math.random but even if you get that image it still doesn't match the one on the screen. Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.