Bot-Factory 602 Posted January 19, 2014 Report Share Posted January 19, 2014 Hello. Is there a way to automatically set the filename with the "http file download" function? Because sometimes I have a download link which doesn't contain a filename. So I can't use things like {$plugin function("File Management.dll", "$file name", #nextdownload)} It looks like the "http file dwonload" function always needs a filename. Would be great if I only could specify a folder, and the plugin would use the name of the received file automatically. ThanksDan Quote Link to post Share on other sites
Code Docta (Nick C.) 638 Posted January 19, 2014 Report Share Posted January 19, 2014 Regex the file name out of the url b4 downloading it and shuv into a variable Quote Link to post Share on other sites
Aymen 385 Posted January 19, 2014 Author Report Share Posted January 19, 2014 New update with couple of fixes and improvements !*Added a small command : http basic mode to allow you to run http get and http post on basic mode(a mode i created myself from the primitive socket class) : this mode will allow you to work with hosted wordpress blog (see the wp http example ubot file) and many other sites!PS: the basic mode may have errors when it comes to proxies so use proxies with caution for this mode proxy format is : http proxies : http : // ip:port socks4 proxies : socks4 : // ip:port socks5 proxies : socks5 : // ip:portObviously without the space PPS: this mode should be used in a http container only*Fixed : added a workaround for http captcha dialog causing STA threading error (see example file) , use it inside a thread container command from the local dictionary plugin freely available here*Added keyboard enter event for http captcha dialog 4 Quote Link to post Share on other sites
HelloInsomnia 1103 Posted January 19, 2014 Report Share Posted January 19, 2014 Hi Aymen, Thanks for the update. How do we know when to use basic mode? Quote Link to post Share on other sites
Steve 30 Posted January 19, 2014 Report Share Posted January 19, 2014 Thanks Aymen! I was thinking the same thing as Nick -- how do we know which sites to use basic mode vs the original way? Quote Link to post Share on other sites
Marton 48 Posted January 19, 2014 Report Share Posted January 19, 2014 Hey Aymen, thanks so much for remembering to fix the captcha dialog. I tested it, and it works, but I found something interesting. The image can't be deleted after using the captcha dialog (my bot automatically deletes the image after solving it). It actually brings up a windows error. Also, I tried stopping the bot and manually deleting the file, but that didn't work either. I actually had to close the bot to be able to delete the image. Any workaround for this?Thank you & all the best,Marton Quote Link to post Share on other sites
Aymen 385 Posted January 19, 2014 Author Report Share Posted January 19, 2014 Hi Aymen, Thanks for the update. How do we know when to use basic mode? Thanks Aymen! I was thinking the same thing as Nick -- how do we know which sites to use basic mode vs the original way? When you fail to send a http request using the normal mode you can try the basic mode because it is coded in a different way!the basic mode works great but there is no support for redirection in this mode also there is no support for the other helper commands like status codes ..etcits just an alternative way to send a http request! Hey Aymen, thanks so much for remembering to fix the captcha dialog. I tested it, and it works, but I found something interesting. The image can't be deleted after using the captcha dialog (my bot automatically deletes the image after solving it). It actually brings up a windows error. Also, I tried stopping the bot and manually deleting the file, but that didn't work either. I actually had to close the bot to be able to delete the image. Any workaround for this? Thank you & all the best,Martonno idea whats causing this , i'll check this out from my end 1 Quote Link to post Share on other sites
SaHiN 14 Posted January 19, 2014 Report Share Posted January 19, 2014 hi aymen, new update thank you. wp http example error HTTP/1.1 404 Not Found Transfer-Encoding: chunked Date: Sun, 19 Jan 2014 23:40:43 GMT Server: LiteSpeed Connection: close X-Powered-By: PHP/5.3.21 X-Pingback: http://www.websiteeeeee.com/xmlrpc.php Expires: Wed, 11 Jan 1984 05:00:00 GMT Cache-Control: no-cache, must-revalidate, max-age=0 Pragma: no-cache Content-Type: text/html; charset=UTF-8 1000 Quote Link to post Share on other sites
jamesfar 15 Posted January 20, 2014 Report Share Posted January 20, 2014 New update with couple of fixes and improvements ! *Added a small command : http basic mode to allow you to run http get and http post on basic mode(a mode i created myself from the primitive socket class) : this mode will allow you to work with hosted wordpress blog (see the wp http example ubot file) and many other sites!PS: the basic mode may have errors when it comes to proxies so use proxies with caution for this mode proxy format is : http proxies : http : // ip:port socks4 proxies : socks4 : // ip:port socks5 proxies : socks5 : // ip:portObviously without the space PPS: this mode should be used in a http container only *Fixed : added a workaround for http captcha dialog causing STA threading error (see example file) , use it inside a thread container command from the local dictionary plugin freely available here*Added keyboard enter event for http captcha dialog Where is the update download link Aymen? UPDATE : Got it. Thanks Quote Link to post Share on other sites
jamesfar 15 Posted January 20, 2014 Report Share Posted January 20, 2014 hi aymen, new update thank you. wp http example error HTTP/1.1 404 Not Found Transfer-Encoding: chunked Date: Sun, 19 Jan 2014 23:40:43 GMT Server: LiteSpeed Connection: close X-Powered-By: PHP/5.3.21 X-Pingback: http://www.websiteeeeee.com/xmlrpc.php Expires: Wed, 11 Jan 1984 05:00:00 GMT Cache-Control: no-cache, must-revalidate, max-age=0 Pragma: no-cache Content-Type: text/html; charset=UTF-8 1000 Got similiar error : HTTP/1.1 404 Not Found Date: Mon, 20 Jan 2014 06:45:29 GMT Server: LiteSpeed Connection: close X-Powered-By: PHP/5.3.28 X-Pingback: http://website.org/xmlrpc.php Content-Type: text/html; charset=UTF-8 Expires: Wed, 11 Jan 1984 05:00:00 GMT Cache-Control: no-cache, must-revalidate, max-age=0 Pragma: no-cache Content-Length: 5684 Quote Link to post Share on other sites
Aymen 385 Posted January 20, 2014 Author Report Share Posted January 20, 2014 Got similiar error : HTTP/1.1 404 Not Found Date: Mon, 20 Jan 2014 06:45:29 GMT Server: LiteSpeed Connection: close X-Powered-By: PHP/5.3.28 X-Pingback: http://website.org/xmlrpc.php Content-Type: text/html; charset=UTF-8 Expires: Wed, 11 Jan 1984 05:00:00 GMT Cache-Control: no-cache, must-revalidate, max-age=0 Pragma: no-cache Content-Length: 5684 did you check out the wp http example source code file ?here is a proof that it is working great from my side , and i checked with at least 5 wp blogshttp://screencast.com/t/HPyGdrN4O Quote Link to post Share on other sites
SaHiN 14 Posted January 20, 2014 Report Share Posted January 20, 2014 did you check out the wp http example source code file ?here is a proof that it is working great from my side , and i checked with at least 5 wp blogshttp://screencast.com/t/HPyGdrN4O yesi the same code. Dont working. Error - HTTP/1.1 404 Not Found Transfer-Encoding .... My pc Langue - Turkish1. my site Langue - Turkish ( don't work)2. my site langue - english ( don't work) Quote Link to post Share on other sites
jamesfar 15 Posted January 20, 2014 Report Share Posted January 20, 2014 did you check out the wp http example source code file ?here is a proof that it is working great from my side , and i checked with at least 5 wp blogshttp://screencast.com/t/HPyGdrN4O I got that error using wp http example source code Quote Link to post Share on other sites
Aymen 385 Posted January 22, 2014 Author Report Share Posted January 22, 2014 made some tweaking to the wp login source code , now it works with the latest version of wpsource code is attached belowAs i said , there is nothing wrong with the http post plugin , you just need to be creative when it comes to sending http requests!wp http example.ubot 1 Quote Link to post Share on other sites
Ptrick125 45 Posted January 22, 2014 Report Share Posted January 22, 2014 If you need help learning how to solve captchas with sign up bots, I made a tutorial that can show you how to make your own sign up bot with the plugin. http://www.ubotstudio.com/forum/index.php?/topic/15786-tutorial-http-post-plugin-signup-with-captchas-source-code/ Quote Link to post Share on other sites
Bot-Factory 602 Posted January 27, 2014 Report Share Posted January 27, 2014 Hello what is the correct "HTTP post plugin" command for "scrape attribute?Should I run http get and then use "html parser"Or should I use "Page scraper" first? I struggle a little bit with "html parser". I looked at the source code examples, but couldn't find one about html parser. With $scrape attribute I use:Element to scrape = <id="change-for-service">Attribute to scrape = innertext How can I translate that to the html parser? Would be really great if someone could post some advice on how to use the plugin to scrape data.Getting easy stuff like URLs is working fine for me. I can do that with RegEX. But I struggle to get text from a page. If I only need text from a certain element or area. Thanks in advance for your help.Dan Quote Link to post Share on other sites
Aymen 385 Posted January 27, 2014 Author Report Share Posted January 27, 2014 Hello what is the correct "HTTP post plugin" command for "scrape attribute?Should I run http get and then use "html parser"Or should I use "Page scraper" first? I struggle a little bit with "html parser". I looked at the source code examples, but couldn't find one about html parser. With $scrape attribute I use:Element to scrape = <id="change-for-service">Attribute to scrape = innertext How can I translate that to the html parser? Would be really great if someone could post some advice on how to use the plugin to scrape data.Getting easy stuff like URLs is working fine for me. I can do that with RegEX. But I struggle to get text from a page. If I only need text from a certain element or area. Thanks in advance for your help.Dan if you have some Xpath knowledge you can use xpath parser its better and more efficient than html parser , but i have couple of video tutorials on how to use both functions , search this thread or check the main videos list! Quote Link to post Share on other sites
HelloInsomnia 1103 Posted January 27, 2014 Report Share Posted January 27, 2014 @Dan use xpath for sure, its pretty easy here is a template for you: set(#var, " <html><head><link rel=\"stylesheet\" type=\"text/css\" href=\"news.css?Du7mDnhzkStl5VdTipHx\"> <link rel=\"shortcut icon\" href=\"favicon.ico\"> <script type=\"text/javascript\"> function byId(id) \{ return document.getElementById(id); \} function vote(node) \{ var v = node.id.split(/_/); // \{\'up\', \'123\'\} var item = v[1]; // hide arrows byId(\'up_\' + item).style.visibility = \'hidden\'; byId(\'down_\' + item).style.visibility = \'hidden\'; // ping server var ping = new Image(); ping.src = node.href; return false; // cancel browser nav \} </script><title>Hacker News</title></head><body> <a href=\"lists\">Lists</a> | <a href=\"rss\">RSS</a> | <a href=\"http://ycombinator.com/bookmarklet.html\">Bookmarklet</a> | <a href=\"http://ycombinator.com/newsguidelines.html\">Guidelines</a> | <a href=\"http://ycombinator.com/newsfaq.html\">FAQ</a> | <a href=\"dmca.html\">DMCA</a> | <a href=\"http://ycombinator.com/newsnews.html\">News News</a> | <a href=\"item?id=363\">Feature Requests</a> | <a href=\"https://github.com/HackerNews/HN/issues\">Bugs</a> | <a href=\"http://ycombinator.com\">Y Combinator</a> | <a href=\"http://ycombinator.com/apply.html\">Apply</a> | <a href=\"http://ycombinator.com/lib.html\">Library</a></span><br><br> <div id=\"change-for-service\"> Hi dan, this is what you\'re looking for </div> <form method=get action=\"//hn.algolia.com/\">Search: <input type=text name=\"q\" value=\"\" size=17></form><br> </center></td></tr></table></center></body></html> ", "Global") alert($plugin function("HTTP post.dll", "$xpath parser", #var, "//div[@id=\'change-for-service\']", "InnerText")) 1 Quote Link to post Share on other sites
Marton 48 Posted February 1, 2014 Report Share Posted February 1, 2014 Hey Aymen, thanks so much for remembering to fix the captcha dialog. I tested it, and it works, but I found something interesting. The image can't be deleted after using the captcha dialog (my bot automatically deletes the image after solving it). It actually brings up a windows error. Also, I tried stopping the bot and manually deleting the file, but that didn't work either. I actually had to close the bot to be able to delete the image. Any workaround for this? Thank you & all the best,MartonHi Aymen, have you had a chance to take a look at this? To provide some more info, it only does this when using the manual captcha dialog (inside the needed container). Thanks & all the best,Marton Quote Link to post Share on other sites
Aymen 385 Posted February 2, 2014 Author Report Share Posted February 2, 2014 Hi Aymen, have you had a chance to take a look at this? To provide some more info, it only does this when using the manual captcha dialog (inside the needed container). Thanks & all the best,Marton a workaround would be to try and clear memory as there is a chance that the image is being seen as still being used or opened , so after you call the captcha image try to clear memory Quote Link to post Share on other sites
Marton 48 Posted February 2, 2014 Report Share Posted February 2, 2014 a workaround would be to try and clear memory as there is a chance that the image is being seen as still being used or opened , so after you call the captcha image try to clear memoryThanks for the reply, Aymen! Unfortunately it doesn't work, tried everything, even ccleaner. Do you think it might be because of the thread container we need to use from your other plugin? Using any other captcha service, this doesn't happen (with or without http post commands). Quote Link to post Share on other sites
Marton 48 Posted February 18, 2014 Report Share Posted February 18, 2014 Hi Aymen! Is there any way to use the proxy checker with private proxies? (I mean can we somehow add the credentials too?) Thanks,Marton Quote Link to post Share on other sites
Aymen 385 Posted February 18, 2014 Author Report Share Posted February 18, 2014 Hi Aymen! Is there any way to use the proxy checker with private proxies? (I mean can we somehow add the credentials too?) Thanks,Marton you can use IP credentials! Quote Link to post Share on other sites
Marton 48 Posted February 18, 2014 Report Share Posted February 18, 2014 you can use IP credentials! But not username&password, right? ProxyIP:PORT works fine, but I tried adding username&pass with no luck. Quote Link to post Share on other sites
Aymen 385 Posted February 18, 2014 Author Report Share Posted February 18, 2014 But not username&password, right? ProxyIP:PORT works fine, but I tried adding username&pass with no luck.Proxy checker doesn't support credentials for the time being ! Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.