Aymen 385 Posted March 26, 2013 Author Report Share Posted March 26, 2013 Hey , any videos on the new updates? Particularly the API function. Maybe some resources on all this HTTP stuff to figure out what all this could really mean for us? Like practical uses. Thanks.TC there is alot of stuff and it is hard to make videos for everything , but will try to record some videos to show some examples live ! 1 Quote Link to post Share on other sites
zdot 14 Posted March 28, 2013 Report Share Posted March 28, 2013 http://a1303.hizliresim.com/17/7/kty2z.png Bad idea? this is a great idea 1 Quote Link to post Share on other sites
SaHiN 14 Posted March 28, 2013 Report Share Posted March 28, 2013 this is a great idea Yes, multi theard solution Quote Link to post Share on other sites
orbital 15 Posted March 29, 2013 Report Share Posted March 29, 2013 When you are url encoding are these two the same? john+smithjohn%20smith So do you think it would matter how you send the name in the http post parameter? Quote Link to post Share on other sites
Aymen 385 Posted March 29, 2013 Author Report Share Posted March 29, 2013 When you are url encoding are these two the same? john+smithjohn%20smith So do you think it would matter how you send the name in the http post parameter? both will work great , but i would recommend using the %20 ! Quote Link to post Share on other sites
VentureOnline 49 Posted March 30, 2013 Report Share Posted March 30, 2013 Hey Aymen im noticing an issue where the Download File command doesn't support cookies. If you check this captcha out, it changes on every load. http://www.dailystrength.org/securimage_show.php?sid=8857391af7aa3f1aeb960fb90d0224f4 So you need to download the captcha with the same exact cookies as used to scrape the page otherwise it just reloads a new captcha. Many sites work this way. What would be great as well would be a Navigate command that uses the same cookies as the Page Scraper so that we can just navigate straight to these captchas without downloading them. Not sure how feasible that is though. Either way if you could add cookie & proxy support to the download file command that would solve this issue. Quote Link to post Share on other sites
Aymen 385 Posted March 30, 2013 Author Report Share Posted March 30, 2013 Hey Aymen im noticing an issue where the Download File command doesn't support cookies. If you check this captcha out, it changes on every load. http://www.dailystrength.org/securimage_show.php?sid=8857391af7aa3f1aeb960fb90d0224f4 So you need to download the captcha with the same exact cookies as used to scrape the page otherwise it just reloads a new captcha. Many sites work this way. What would be great as well would be a Navigate command that uses the same cookies as the Page Scraper so that we can just navigate straight to these captchas without downloading them. Not sure how feasible that is though. Either way if you could add cookie & proxy support to the download file command that would solve this issue. Ok , thank you !Noted and will work on it for the next update Quote Link to post Share on other sites
Aymen 385 Posted March 30, 2013 Author Report Share Posted March 30, 2013 Hello guys ,recorded some tutorials : html encode and decode , url encode and decode :http://screencast.com/t/8T4ZiFcU0Lt Using API function , proxy command , timeout command :http://screencast.com/t/XVFdjdgSU1 Small multithreading example :http://screencast.com/t/PPzdDKhNk89x 1 Quote Link to post Share on other sites
Kreatus (Ubot Ninja) 422 Posted March 30, 2013 Report Share Posted March 30, 2013 Hello guys ,recorded some tutorials : html encode and decode , url encode and decode :http://screencast.com/t/8T4ZiFcU0Lt Using API function , proxy command , timeout command :http://screencast.com/t/XVFdjdgSU1 Small multithreading example :http://screencast.com/t/PPzdDKhNk89x Thanks for the tutorials. URL decode is very useful on the bot i am currently working on. I have a question. What is the difference between HTTP POST and Page scraper when it comes to page scraping?Please check the sample code below. Both will have the same result. Maybe i missed something. Thanks plugin command("HTTP post.dll", "HTTP POST", "http://www.custombotsolutions.com", "", "", "", #test) { } plugin command("HTTP post.dll", "Page Scraper", "http://www.custombotsolutions.com/", "", #test2) { } Quote Link to post Share on other sites
Aymen 385 Posted March 30, 2013 Author Report Share Posted March 30, 2013 Thanks for the tutorials. URL decode is very useful on the bot i am currently working on. I have a question. What is the difference between HTTP POST and Page scraper when it comes to page scraping?Please check the sample code below. Both will have the same result. Maybe i missed something. Thanks plugin command("HTTP post.dll", "HTTP POST", "http://www.custombotsolutions.com", "", "", "", #test) { } plugin command("HTTP post.dll", "Page Scraper", "http://www.custombotsolutions.com/", "", #test2) { } HTTP post command makes a post request , and page scraper makes a get request , both will work as scraper in many websites but i would stick to page scraper for scraping so you don't run into some code errors ! Quote Link to post Share on other sites
VentureOnline 49 Posted March 30, 2013 Report Share Posted March 30, 2013 Ok , thank you !Noted and will work on it for the next update You're the best Aymen, thanks for the great support! Quote Link to post Share on other sites
SaHiN 14 Posted March 30, 2013 Report Share Posted March 30, 2013 Hello guys ,recorded some tutorials : html encode and decode , url encode and decode :http://screencast.com/t/8T4ZiFcU0Lt Using API function , proxy command , timeout command :http://screencast.com/t/XVFdjdgSU1 Small multithreading example :http://screencast.com/t/PPzdDKhNk89x Small multithreading http post Don't working. Error. Quote Link to post Share on other sites
Aymen 385 Posted March 30, 2013 Author Report Share Posted March 30, 2013 Small multithreading http post Don't working. Error.why error ?whats the error you are getting ? , tested it and worked , so should work for everyone ! Quote Link to post Share on other sites
a2mateit 395 Posted March 31, 2013 Report Share Posted March 31, 2013 Hello guys ,recorded some tutorials : html encode and decode , url encode and decode :http://screencast.com/t/8T4ZiFcU0Lt Using API function , proxy command , timeout command :http://screencast.com/t/XVFdjdgSU1 Small multithreading example :http://screencast.com/t/PPzdDKhNk89x Hey Aymen, Seen you made a video with my mulit-threading example. Thank you, I'm sure this will help alot of people. Quote Link to post Share on other sites
Aymen 385 Posted March 31, 2013 Author Report Share Posted March 31, 2013 Limited Time Promotion : Promo code : EASTER201320% OffExpires in 2 days Quote Link to post Share on other sites
VaultBoss 310 Posted March 31, 2013 Report Share Posted March 31, 2013 Great! Just took advantage of Aymen's EASTER Offer and bought the plugin today. I stood still for a while, waiting to see how well the plugin would be developed and supported. I have to say: Aymen's dedication to expand its capabilities, and add new functionality (commands/functions), makes this a stellar Ubot Plugin, an acquisition well-worth the full price, not to mention the discounted purchase. If you guys/gals read this now and haven't bought Aymen's plugin yet... I think you lose, you're missing the boat here... Just sayin'... I'm no evangelist or affiliate of Aymen's - maybe he doesn't even like me much... so this is coming from my firm belief that this is a great investment and a MUST-HAVE tool in any serious UBotter's arsenal. Cheers, Aymen and kudos, once again, for the great work!You stand out as an example of how to care for the customers. Quote Link to post Share on other sites
Aymen 385 Posted March 31, 2013 Author Report Share Posted March 31, 2013 Great! Just took advantage of Aymen's EASTER Offer and bought the plugin today. I stood still for a while, waiting to see how well the plugin would be developed and supported. I have to say: Aymen's dedication to expand its capabilities, and add new functionality (commands/functions), makes this a stellar Ubot Plugin, an acquisition well-worth the full price, not to mention the discounted purchase. If you guys/gals read this now and haven't bought Aymen's plugin yet... I think you lose, you're missing the boat here... Just sayin'... I'm no evangelist or affiliate of Aymen's - maybe he doesn't even like me much... so this is coming from my firm belief that this is a great investment and a MUST-HAVE tool in any serious UBotter's arsenal. Cheers, Aymen and kudos, once again, for the great work!You stand out as an example of how to care for the customers. Thanks alot for the kind words man ! i really appreciate it Quote Link to post Share on other sites
SaHiN 14 Posted March 31, 2013 Report Share Posted March 31, 2013 why error ?whats the error you are getting ? , tested it and worked , so should work for everyone ! Sory Aymen, site problem. I'm sory. Nice working System.Net.ProtocolViolationException: [begin]GetResponse çağrısı yapmadan önce ContentLength baytlarını istek akışına yazmanız gerekir. konum: System.Net.HttpWebRequest.GetResponse() konum: HTTP_post.Webclient_Sockets_plugin.Execute(IUBotStudio ubotStudio, Dictionary`2 parameters) Quote Link to post Share on other sites
Code Docta (Nick C.) 638 Posted April 1, 2013 Report Share Posted April 1, 2013 Hey Aymen, Just want to say your plugins are awesome and I'd bye again at full price!! Thanks for the Videos and keep up the good work!! 1 Quote Link to post Share on other sites
a2mateit 395 Posted April 2, 2013 Report Share Posted April 2, 2013 Hey Aymen, Sorry if this isn't the right place to post this. If so, feel free to remove it. Anychance you can put togehter some example code showing how to use the http post for this site: http://0-film.com/signup.php I believe it's using session cookies, and I cannot figure out how to successfully solve the captcha. I have figured out how to do alot of sites on my own, but I am stuck on this one and would really appreciate some help. TIA Quote Link to post Share on other sites
VentureOnline 49 Posted April 2, 2013 Report Share Posted April 2, 2013 Grab the recaptcha challenge URL and view it. Should be something like this. http://www.google.com/recaptcha/api/challenge?k=6LcQI8ESAAAAALN1vYQovst9c6nlU52iHdqWExp8 Then grab the actual challenge code which should be something like this. challenge : '03AHJ_VuvsoC8nMt3QLrkJzki3A-3w63TYQ5zcGnaZuql2QhnuHBf6sGRsww4ZnobOzoPeSTE-9mbZLbll4wdWz7bAfRg4dpu92lgkmSRZa47kIuzNn_s2aQ6pcT4PCFO3tmmCLJKs69FONh2YxPSNzwAVYXK_OPiEll7ieIYxZgE5hnpr2VZGkIQ', Then take the challenge code and append it to this URL like so. https://www.google.com/recaptcha/api/image?c=03AHJ_VuvsoC8nMt3QLrkJzki3A-3w63TYQ5zcGnaZuql2QhnuHBf6sGRsww4ZnobOzoPeSTE-9mbZLbll4wdWz7bAfRg4dpu92lgkmSRZa47kIuzNn_s2aQ6pcT4PCFO3tmmCLJKs69FONh2YxPSNzwAVYXK_OPiEll7ieIYxZgE5hnpr2VZGkIQ And there you have it Its a pain in the.... but it works. Quote Link to post Share on other sites
a2mateit 395 Posted April 2, 2013 Report Share Posted April 2, 2013 Grab the recaptcha challenge URL and view it. Should be something like this. http://www.google.com/recaptcha/api/challenge?k=6LcQI8ESAAAAALN1vYQovst9c6nlU52iHdqWExp8 Then grab the actual challenge code which should be something like this. challenge : '03AHJ_VuvsoC8nMt3QLrkJzki3A-3w63TYQ5zcGnaZuql2QhnuHBf6sGRsww4ZnobOzoPeSTE-9mbZLbll4wdWz7bAfRg4dpu92lgkmSRZa47kIuzNn_s2aQ6pcT4PCFO3tmmCLJKs69FONh2YxPSNzwAVYXK_OPiEll7ieIYxZgE5hnpr2VZGkIQ', Then take the challenge code and append it to this URL like so. https://www.google.com/recaptcha/api/image?c=03AHJ_VuvsoC8nMt3QLrkJzki3A-3w63TYQ5zcGnaZuql2QhnuHBf6sGRsww4ZnobOzoPeSTE-9mbZLbll4wdWz7bAfRg4dpu92lgkmSRZa47kIuzNn_s2aQ6pcT4PCFO3tmmCLJKs69FONh2YxPSNzwAVYXK_OPiEll7ieIYxZgE5hnpr2VZGkIQ And there you have it Its a pain in the.... but it works. Thanks for the quick reply. I'm feeling like my brain just isn't working today. Need to see some actual code to wrap my head around it. Quote Link to post Share on other sites
Aymen 385 Posted April 2, 2013 Author Report Share Posted April 2, 2013 Thanks for the quick reply. I'm feeling like my brain just isn't working today. Need to see some actual code to wrap my head around it. Yea , it is exactly like VentureOnline said !i will be making an example tutorial on this hopefully soon along with more tutorials and source codes ! Quote Link to post Share on other sites
Aymen 385 Posted April 2, 2013 Author Report Share Posted April 2, 2013 Update 1.6 -added a new function : $strip html tags : removes all html tags from a text-added a new command : list scraper : gives you many options of what to scrape from a given text (currently there is URL, emails , proxies, dates , phone numbers)-fixed a problem with clearning cookies-fixed a problem where the server could choke and return a 417 error Check your email for the update PS: make sure to add the plugin again to get the update 1 Quote Link to post Share on other sites
VentureOnline 49 Posted April 2, 2013 Report Share Posted April 2, 2013 Hey Aymen did this update add the cookie support to the download file feature? Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.