Praney Behl 314 Posted August 5, 2013 Report Share Posted August 5, 2013 Waiting for the update email. Quote Link to post Share on other sites
Aymen 385 Posted August 5, 2013 Author Report Share Posted August 5, 2013 Waiting for the update email. i already sent it , check your inbox !or pm me if you don't have it Quote Link to post Share on other sites
Praney Behl 314 Posted August 5, 2013 Report Share Posted August 5, 2013 Ok just found in another mail folder. Thanks mate. Quote Link to post Share on other sites
mat123pl 2 Posted August 5, 2013 Report Share Posted August 5, 2013 I can not make a similar header post:Please write an example. POST /general/competition/send-vote/ HTTP/1.1 Host mrozonakawa.pl User-Agent Mozilla/5.0 (Windows NT 5.1; rv:22.0) Gecko/20100101 Firefox/22.0 Accept application/json, text/javascript, */*; q=0.01 Accept-Language pl,en-us;q=0.7,en;q=0.3 Accept-Encoding gzip, deflate Content-Type application/x-www-form-urlencoded; charset=UTF-8 X-Requested-With XMLHttpRequest Referer http://mrozonakawa.pl/konkurs Content-Length 35 Cookie sid=gacqj16hi8e9bpomh4tb7cife2; __utma=135989677.39136442.1375701536.1375701536.1375708113.2; __utmc=135989677; __utmz=135989677.1375701536.1.1.utmcsr=google|utmccn=(organic)|utmcmd=organic|utmctr=(not%20provided); usecache=1; __utmb=135989677.3.10.1375708113 Connection keep-alive Pragma no-cache Cache-Control no-cache Quote Link to post Share on other sites
Aymen 385 Posted August 5, 2013 Author Report Share Posted August 5, 2013 I can not make a similar header post:Please write an example. POST /general/competition/send-vote/ HTTP/1.1 Host mrozonakawa.pl User-Agent Mozilla/5.0 (Windows NT 5.1; rv:22.0) Gecko/20100101 Firefox/22.0 Accept application/json, text/javascript, */*; q=0.01 Accept-Language pl,en-us;q=0.7,en;q=0.3 Accept-Encoding gzip, deflate Content-Type application/x-www-form-urlencoded; charset=UTF-8 X-Requested-With XMLHttpRequest Referer http://mrozonakawa.pl/konkurs Content-Length 35 Cookie sid=gacqj16hi8e9bpomh4tb7cife2; __utma=135989677.39136442.1375701536.1375701536.1375708113.2; __utmc=135989677; __utmz=135989677.1375701536.1.1.utmcsr=google|utmccn=(organic)|utmcmd=organic|utmctr=(not%20provided); usecache=1; __utmb=135989677.3.10.1375708113 Connection keep-alive Pragma no-cache Cache-Control no-cache i don't understand your question ? Quote Link to post Share on other sites
mat123pl 2 Posted August 5, 2013 Report Share Posted August 5, 2013 I can not set the correct header parameters. Correct headershttp://oi40.tinypic.com/20pc084.jpg Actual headershttp://oi41.tinypic.com/2cy372e.jpg Quote Link to post Share on other sites
Aymen 385 Posted August 6, 2013 Author Report Share Posted August 6, 2013 I can not set the correct header parameters. Correct headershttp://oi40.tinypic.com/20pc084.jpg Actual headershttp://oi41.tinypic.com/2cy372e.jpg i'm sorry i do not have time to make custom examples for everyone!what would help is opening the example codes i made and try to learn from what i did Quote Link to post Share on other sites
mat123pl 2 Posted August 6, 2013 Report Share Posted August 6, 2013 I read all the source code and there was not anything like that. My code:plugin command("HTTP post.dll", "http clear headers")plugin command("HTTP post.dll", "HTTP POST", "http://mrozonakawa.pl/user/auth/index", "login_form%5Busername%5D=bar-mal907&login_form%5Bpassword%5D=ahqL9ebkVE", "Mozilla/5.0 (Windows NT 5.1; rv:22.0) Gecko/20100101 Firefox/22.0", "http://mrozonakawa.pl/rejestracja", #html) {}set(#licznik, 0, "Global")plugin command("HTTP post.dll", "HTTP POST", "http://mrozonakawa.pl/general/competition/get-applications/", "id=0", "Mozilla/5.0 (Windows NT 5.1; rv:22.0) Gecko/20100101 Firefox/22.0", "http://mrozonakawa.pl/", #html) {}clear list(%id)add list to list(%id, $find regular expression(#html, "(?<=\"id\":\").*?(?=\")"), "Delete", "Global")plugin command("HTTP post.dll", "http set headers", "Accept", "application/json, text/javascript, */*; q=0.01")plugin command("HTTP post.dll", "http set headers", "Accept-Language", "pl,en-us;q=0.7,en;q=0.3")plugin command("HTTP post.dll", "http set headers", "Accept-Encoding", "gzip, deflate")plugin command("HTTP post.dll", "http set headers", "X-Requested-With", "XMLHttpRequest")plugin command("HTTP post.dll", "http set contenttype", "application/x-www-form-urlencoded; charset=UTF-8")set(#html, $plugin function("HTTP post.dll", "$http post", "http://mrozonakawa.pl/general/competition/send-vote/", "pair%5B%5D=221&pair%5B%5D=143", "Mozilla/5.0 (Windows NT 5.1; rv:22.0) Gecko/20100101 Firefox/22.0", "http://mrozonakawa.pl/konkurs", "", ""), "Global") I always get:#html: Specified value has invalid HTTP Header characters.Parameter name: name Quote Link to post Share on other sites
Aymen 385 Posted August 6, 2013 Author Report Share Posted August 6, 2013 Certain Headers like Accept-Encoding , and Accept-Language can not be set with the http set headers , you need to use the commands i built for that , http set headers is only for adding special headers that comes only with certain websites , like the token headers for example! Quote Link to post Share on other sites
mat123pl 2 Posted August 6, 2013 Report Share Posted August 6, 2013 I'll do this with your plugin?I do not know what commands you mean? Quote Link to post Share on other sites
a2mateit 395 Posted August 7, 2013 Report Share Posted August 7, 2013 Certain Headers like Accept-Encoding , and Accept-Language can not be set with the http set headers , you need to use the commands i built for that , http set headers is only for adding special headers that comes only with certain websites , like the token headers for example! I am just now starting to really, really utilize this plugin. I gotta say that you should really do a wiki (or videos, but I know your a busy guy) for all the commands because I know they are all super powerful! Then you need to raise the price to like $197 just because this is really that powerful. Been wrapping up a ton of projects, but now I am really diggin into this and learning how to use it and it is really SO much better than relying on the browser. Anybody on the fence about this plugin, I'd say buy it now before the price goes up. Super glad I got it at $47 (even though I am just now learning to use it a couple months later). Looking forward to more documentation and videos on how to use this powerful plugin in the future (as well as your updates). 1 Quote Link to post Share on other sites
Sanjeev 46 Posted August 7, 2013 Report Share Posted August 7, 2013 it is really SO much better than relying on the browser. To those of us,who have understood browser based coding and plan to go commercial with it, this sounds a bit worrying.. I have been reading many posts with constant complaints of browser crashes.. a2mateit? would you say that browser based bots are never really crash proof and customers are bound to complaint sooner or later - no matter how many safe gaurds you may add to your Bot?And that , HTTP post based coding would be the only practical way forward?Thanks, I'm looking forward to hearing what you and other experienced users would have to say on this subject. Quote Link to post Share on other sites
Aymen 385 Posted August 7, 2013 Author Report Share Posted August 7, 2013 I am just now starting to really, really utilize this plugin. I gotta say that you should really do a wiki (or videos, but I know your a busy guy) for all the commands because I know they are all super powerful! Then you need to raise the price to like $197 just because this is really that powerful. Been wrapping up a ton of projects, but now I am really diggin into this and learning how to use it and it is really SO much better than relying on the browser. Anybody on the fence about this plugin, I'd say buy it now before the price goes up. Super glad I got it at $47 (even though I am just now learning to use it a couple months later). Looking forward to more documentation and videos on how to use this powerful plugin in the future (as well as your updates). its on my todo list to create a detailed documentation with some detailed video totorials and maybe some case studies too ! Quote Link to post Share on other sites
a2mateit 395 Posted August 7, 2013 Report Share Posted August 7, 2013 To those of us,who have understood browser based coding and plan to go commercial with it, this sounds a bit worrying.. I have been reading many posts with constant complaints of browser crashes.. a2mateit? would you say that browser based bots are never really crash proof and customers are bound to complaint sooner or later - no matter how many safe gaurds you may add to your Bot?And that , HTTP post based coding would be the only practical way forward?Thanks, I'm looking forward to hearing what you and other experienced users would have to say on this subject. You misunderstood my comment. Browser based bots are still good for a lot of things. There are some things you cannot use the http post plugin for. But, using this plugin is so much faster in terms of speed... Quote Link to post Share on other sites
Sanjeev 46 Posted August 7, 2013 Report Share Posted August 7, 2013 Thanks for clearing that up! Quote Link to post Share on other sites
mat123pl 2 Posted August 9, 2013 Report Share Posted August 9, 2013 I read all the source code and there was not anything like that. My code:plugin command("HTTP post.dll", "http clear headers")plugin command("HTTP post.dll", "HTTP POST", "http://mrozonakawa.pl/user/auth/index", "login_form%5Busername%5D=bar-mal907&login_form%5Bpassword%5D=ahqL9ebkVE", "Mozilla/5.0 (Windows NT 5.1; rv:22.0) Gecko/20100101 Firefox/22.0", "http://mrozonakawa.pl/rejestracja", #html) {}set(#licznik, 0, "Global")plugin command("HTTP post.dll", "HTTP POST", "http://mrozonakawa.pl/general/competition/get-applications/", "id=0", "Mozilla/5.0 (Windows NT 5.1; rv:22.0) Gecko/20100101 Firefox/22.0", "http://mrozonakawa.pl/", #html) {}clear list(%id)add list to list(%id, $find regular expression(#html, "(?<=\"id\":\").*?(?=\")"), "Delete", "Global")plugin command("HTTP post.dll", "http set headers", "Accept", "application/json, text/javascript, */*; q=0.01")plugin command("HTTP post.dll", "http set headers", "Accept-Language", "pl,en-us;q=0.7,en;q=0.3")plugin command("HTTP post.dll", "http set headers", "Accept-Encoding", "gzip, deflate")plugin command("HTTP post.dll", "http set headers", "X-Requested-With", "XMLHttpRequest")plugin command("HTTP post.dll", "http set contenttype", "application/x-www-form-urlencoded; charset=UTF-8")set(#html, $plugin function("HTTP post.dll", "$http post", "http://mrozonakawa.pl/general/competition/send-vote/", "pair%5B%5D=221&pair%5B%5D=143", "Mozilla/5.0 (Windows NT 5.1; rv:22.0) Gecko/20100101 Firefox/22.0", "http://mrozonakawa.pl/konkurs", "", ""), "Global") I always get:#html: Specified value has invalid HTTP Header characters.Parameter name: name I did not get a solution to my questions? What are the commands used to program work well?How do I make the script worked. I paid and no support ... Quote Link to post Share on other sites
HelloInsomnia 1103 Posted August 9, 2013 Report Share Posted August 9, 2013 Hi Aymen, Can you show a quick example for the xpath? I can't seem to get it for some reason. Just an example to put into the xpath and input you don't need to make a video or anything I'll figure it out from there. Loving the updates by the way! Quote Link to post Share on other sites
Aymen 385 Posted August 9, 2013 Author Report Share Posted August 9, 2013 Hi Aymen, Can you show a quick example for the xpath? I can't seem to get it for some reason. Just an example to put into the xpath and input you don't need to make a video or anything I'll figure it out from there. Loving the updates by the way! ok lets say we have this html code <h3 class="class1"> <a href="link">Innertext</a> </h3> <h3 class="class2"> <a href="link">Innertext</a> </h3>and we only want to scrape all the links in the page under the <h3 class="class1"> only , we use this xpath expression //h3[@class='class1']/a "//" double slash : means we can go straight away to the tag we want (you can use //tagname1//tagname2 too , this means you want to get tagname2 that can be anywhere under a parrent tagname1) "/" single slash : means we should go from the root tag to the child tag without missing any tags in between [@attributename=attribute value] : this is like a rule to check for the tag if it does have a certain attribute name/value this is just a small sum up of what the xpath can do !Hope it is clear enough 1 Quote Link to post Share on other sites
HelloInsomnia 1103 Posted August 9, 2013 Report Share Posted August 9, 2013 That's perfect, thank you! Quote Link to post Share on other sites
Aymen 385 Posted August 9, 2013 Author Report Share Posted August 9, 2013 I did not get a solution to my questions? What are the commands used to program work well?How do I make the script worked. I paid and no support ... I'm not supposed to make custom examples for everyone!i told you what to use to configure your http requests , it should be obvious ! the commands that are used to configure your http requests are : -http set encoding-http set credential-http set contenttype-http set headers ( should be used only with the uncommon headers) if what you want to set is not in this list then it won't work ! Finally Most of what you want to configure is set by default for you , i just added those commands to fix some problems that may happen with some websites! 1 Quote Link to post Share on other sites
Bliss 194 Posted August 9, 2013 Report Share Posted August 9, 2013 I did not get a solution to my questions? What are the commands used to program work well?How do I make the script worked. I paid and no support ... Don't you think thats a bit harsh? no support? hmmmm well seen as this thread is on post #385 then i think he must be supporting / answering questions. Aymens support is second to none, i know that from experience. Perhaps take a look through all the source examples he includes with it, there are loads, or read the other 384 posts in this thread, that might help too. Quote Link to post Share on other sites
mat123pl 2 Posted August 11, 2013 Report Share Posted August 11, 2013 (edited) I read all the posts and examples of nowhere and there is no solution.I bought just plugin that into my goals is useless, and the author can not write me two lines of the example simply because this plugin is underdeveloped. This is an example: plugin command("HTTP post.dll", "http set contenttype", "application/x-www-form-urlencoded; charset=UTF-8")plugin command("HTTP post.dll", "http set encoding", "UTF8")set(#html, $plugin function("HTTP post.dll", "$http post", "http://mrozonakawa.pl/general/competition/send-vote/", "vote=161&pair%5B%5D=161&pair%5B%5D=119", "Mozilla/5.0 (Windows NT 5.1; rv:22.0) Gecko/20100101 Firefox/22.0", "http://mrozonakawa.pl/konkurs", "", ""), "Global") Response from server: #html: The remote server returned an error: (500) Internal Server Error. The author is not anticipated to add these basic headings as:X-Requested-With: XMLHttpRequestAccept: application/json, text/javascript, */*; q=0.01 I regret very much that I bought the non-functional plug-in.Here the solution without a plug if you wanted to: set(#html, $eval("var xml =\"pair%5B%5D=161&pair%5B%5D=162\"req = new XMLHttpRequest();req.open(\"POST\", \"http://mrozonakawa.pl/general/competition/send-vote/\", false);req.setRequestHeader(\"Content-type\", \"application/x-www-form-urlencoded; charset=UTF-8\");req.setRequestHeader(\"X-Requested-With\", \"XMLHttpRequest\");req.setRequestHeader(\"Accept\", \"application/json, text/javascript, */*; q=0.01\");req.setRequestHeader(\"Accept-Language\", \"pl,en-us;q=0.7,en;q=0.3\");req.send(xml);req.responseText;"), "Global") } Edited August 11, 2013 by mat123pl Quote Link to post Share on other sites
kev123 132 Posted August 11, 2013 Report Share Posted August 11, 2013 if there's additional features you need adding why not just ask aymen instead of going on the attack he generally gets these things added/sorted pretty quick Quote Link to post Share on other sites
Macster (UBotter Labs) 112 Posted August 11, 2013 Report Share Posted August 11, 2013 I read all the posts and examples of nowhere and there is no solution.I bought just plugin that into my goals is useless, and the author can not write me two lines of the example simply because this plugin is underdeveloped. mat123pl... to tell the truth i never got the chance to exploit all the plugin's functionality but is one of the best there is for ubot and it saves you of a LOT of time and work. As about aymen, he helped us all around here, though the plugin is pretty much self explanatory in most of his functions. http://screencast.com/t/Nh2DHR6FWRmhttp://screencast.com/t/bWjZAUptihttp://screencast.com/t/0MDlkxRb4http://screencast.com/t/lzI8QCd8s4Xhttp://screencast.com/t/U1bYtCcqLD21http://screencast.com/t/PPzdDKhNk89xhttp://screencast.com/t/XVFdjdgSU1http://screencast.com/t/8T4ZiFcU0Lthttp://screencast.com/t/ToQQEy1Chttp://screencast.com/t/7Nv5YcMtc8kk Quote Link to post Share on other sites
HelloInsomnia 1103 Posted August 13, 2013 Report Share Posted August 13, 2013 Hey Aymen, For some reason it says you can't get PMs so I'll post here. For the xpath using //a for some reason href doesn't work - but the other attributes seem to fine. I wanted to tell you in case its a bug. Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.