mobileconsultant 6 Posted July 11, 2014 Report Share Posted July 11, 2014 Hey entroqy, You are welcome. Btw, Dan has shown in his bonus training video how to use cURL to do HTTP POST along with Ubot Studio Advanced Shell Plugin to accomplish the same thing Aymen's HTTP POST Plugin does plus he mentions that you can leverage more HTTP commands with cURL than the HTTP plugin. But, Aymen has made the HTTP Plugin easy to use with simple dropdown selections where with cURL you need to know what you are doing with the cURL commands and paramenters that you input into the Ubot Studio "shell batch hidden" node. Here is info on cURL: http://curl.haxx.se/cURL is a command line tool for transferring data with URL syntax, supporting DICT, FILE, FTP, FTPS, Gopher, HTTP, HTTPS, IMAP, IMAPS, LDAP, LDAPS, POP3, POP3S, RTMP, RTSP, SCP, SFTP, SMTP, SMTPS, Telnet and TFTP. curl supports SSL certificates, HTTP POST, HTTP PUT, FTP uploading, HTTP form based upload, proxies, cookies, user+password authentication (Basic, Digest, NTLM, Negotiate, kerberos...), file transfer resume, proxy tunneling and a busload of other useful tricks I would highly recommend if you want to do these more advanced techniques that you grab Dan's training, he will shorten your learning curve and troubleshooting headache times by weeks or months. Also, you will want to get Aymen's "Socket Code Generator" to make your Ubotting life easier if you are going to be doing HTTP POST stuff. -Rich Quote Link to post Share on other sites
Bot-Factory 602 Posted July 14, 2014 Author Report Share Posted July 14, 2014 Do You Miss Something? Anything that is not covered yet? To everyone who bough the tutorial videos..This is your chance to request additional videos if something is missing! >>WARNING<<I do NOT want to see requests like:Please do a tutorial on Site XYZ because it's a complicated site and I don't know how to do it.... As mentioned a couple of times, the tutorials are not a "I code for you" thing. I got a lot of requests during the last weeks, where people asked for help.But very often, all they needed was already covered in the tutorials.They didn't really asked for additional tutorials... They wanted someone to do the work for them.I can do that... but not as part of the free support I offer with the tutorials! But if you have a REAL request, where you found a challenge that is not covered so far, here's your chance! >>CLICK HERE TO REQUEST A NEW TUTORIAL<< PS: Websites who are challenging because they are very complex is not what I'm looking for here.Hotmail is a good example. Creating hotmail accounts with HTTP Plugin is relatively complex. But they are not usingnew or stuff we haven't covered in the tutorials. They are just doing a lot of http post and get requests.To solve those sites you just need enough time and patience to trace and understand all the requests. But you don't need a special trick. My List of missing tutorials:1. Captchas2. ?? Your turn now :-) >>CLICK HERE TO REQUEST A NEW TUTORIAL<< Quote Link to post Share on other sites
jamesfar 15 Posted July 19, 2014 Report Share Posted July 19, 2014 Any new tutorial Dan? Login to wordpress blog maybe? Quote Link to post Share on other sites
Bot-Factory 602 Posted July 19, 2014 Author Report Share Posted July 19, 2014 Any new tutorial Dan? Login to wordpress blog maybe? What exactly do you need? Login to wordpress only requires 4 parameters. That's one simple http post request: set(#log, "wp_admin", "Global")set(#pwd, "xxxxxx", "Global")set(#post, $plugin function("HTTP post.dll", "$http post", "http://www.website.com/wp_login", "log={#log}&pwd={#pwd}&wp-submit=Log+In&redirect_to=http%3A%2F%2Fwww.website.com", "Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/36.0.1985.125 Safari/537.36", "http://www.website.com/", "", "20"), "Global")load html(#post) Dan Quote Link to post Share on other sites
jamesfar 15 Posted July 20, 2014 Report Share Posted July 20, 2014 What exactly do you need? Login to wordpress only requires 4 parameters. That's one simple http post request: set(#log, "wp_admin", "Global")set(#pwd, "xxxxxx", "Global")set(#post, $plugin function("HTTP post.dll", "$http post", "http://www.website.com/wp_login", "log={#log}&pwd={#pwd}&wp-submit=Log+In&redirect_to=http%3A%2F%2Fwww.website.com", "Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/36.0.1985.125 Safari/537.36", "http://www.website.com/", "", "20"), "Global")load html(#post) Dan your code above is not working. But no worries i have found how to login to wordpress blog. It needs to pass the cookie manually. Thanks to your video Quote Link to post Share on other sites
Bot-Factory 602 Posted July 20, 2014 Author Report Share Posted July 20, 2014 your code above is not working. But no worries i have found how to login to wordpress blog. It needs to pass the cookie manually. Thanks to your video The code works perfectly fine for my wordpress site. But you might have to modify it depending on your blog settings. So the login URL is different very often depending on your blog configuration. So /wp_login is probably not the right setting for you. You have to sniff you login request via fiddler and then just adjust the settings accordingly. PM me your login URL and I can send you the right parameters. If you want to do additional things after you have logged in, you have to ensure that the authentication cookies are sent correctly for the other commands. And that might not work correctly all the time. So you might have to extract those cookies from the cookie response and set them manually. But that's probably what you have done already. If there is anything else you need just let me know. And you also can PM me your URLs and I will take a closer look at your site if you struggle with something. CheersDan 1 Quote Link to post Share on other sites
jamesfar 15 Posted July 20, 2014 Report Share Posted July 20, 2014 So you might have to extract those cookies from the cookie response and set them manually. But that's probably what you have done already. Yes this is what i have done and works perfectly Thanks Dan Quote Link to post Share on other sites
jamesfar 15 Posted July 20, 2014 Report Share Posted July 20, 2014 Suggestions for next tutorial videos : - Login to cPanel- Add Addon / Sub Domain- Install wordpress via softaculous Quote Link to post Share on other sites
GPL 0 Posted July 30, 2014 Report Share Posted July 30, 2014 will get this soon Quote Link to post Share on other sites
Bot-Factory 602 Posted July 30, 2014 Author Report Share Posted July 30, 2014 will get this soon Hello. If you are looking for something specific please let me know. I will tell you if the tutorial will help you with that. Dan Quote Link to post Share on other sites
Bot-Factory 602 Posted August 2, 2014 Author Report Share Posted August 2, 2014 Update I have a new Bonus video ready for distribution (Google Recaptcha via HTTP Plugin).The video needs some final editing. But I will finish it this weekend. I'm also working on a HTTP scraping tutorial. Some people have asked for that. I try to release both of them within the next 1-3 days guys. CheersDan Quote Link to post Share on other sites
Pete_UK 9 Posted August 2, 2014 Report Share Posted August 2, 2014 I saw you have a video covering something to do with Amazon Seller Central. Is that how to use the Seller Central API to get data? Quote Link to post Share on other sites
Bot-Factory 602 Posted August 2, 2014 Author Report Share Posted August 2, 2014 I saw you have a video covering something to do with Amazon Seller Central. Is that how to use the Seller Central API to get data? Hi. Yes and No :-)I was not using the API directly. But the website itself is accessing some kind of API in the background as well. I was just sniffing the requests from the website and replicated that with the http plugin. Which was the easiest way to get the results I needed. But the video doesn't cover how to use the Marketplace Web Service api directly. Dan Quote Link to post Share on other sites
Bot-Factory 602 Posted August 2, 2014 Author Report Share Posted August 2, 2014 Bonus Video 4 is ready: Bonus4-Expireddomains-register.mp4 Bonus4-Expireddomains-Login-Scrape.mp4 Login to: http://www.bot-factory.com/ Navigate to: Purchase History I will work on Bonus Video 5 tomorrow 1 Quote Link to post Share on other sites
Bot-Factory 602 Posted August 4, 2014 Author Report Share Posted August 4, 2014 Bonus Video 5 is ready: Xing-Recaptcha-AccountCreator In this video we will create an account creator bot for xing.comAnd solve a tricky recaptcha image during that process 2 Quote Link to post Share on other sites
Black Automation 20 Posted August 4, 2014 Report Share Posted August 4, 2014 Thanks again Dan for all your hard work. Quote Link to post Share on other sites
Bot-Factory 602 Posted August 4, 2014 Author Report Share Posted August 4, 2014 Thanks again Dan for all your hard work.Would love to hear some feedback on the new Bonus Video 5. Took me a while to figure out that stuff. So hopefully it's helpful for you guys. Dan Quote Link to post Share on other sites
rocket976 62 Posted August 4, 2014 Report Share Posted August 4, 2014 You've been busy Dan! I didnt notice the other 4 bonus before this one so Im starting at the top Ill let you know when Im done. Great value regardless thanks bud! Quote Link to post Share on other sites
Bot-Factory 602 Posted August 20, 2014 Author Report Share Posted August 20, 2014 It got a little bit quiet here in this thread. But I'm still talking to some of you about HTTP plugin and the tutorials. So if there are open questions, please let me know. Only 7 more sales until the next bonus video series! So if you are still on the fence... Here's a small motivator for you to come on board. I'm running a 48 hours vacation special deal for you.25% Discount Code: vacationx23 Hope to see you on the inside! CheersDan Quote Link to post Share on other sites
BoosterBots 23 Posted August 21, 2014 Report Share Posted August 21, 2014 Awesome! going to snatch this deal right now thanks Dan! 1 Quote Link to post Share on other sites
Pete_UK 9 Posted August 30, 2014 Report Share Posted August 30, 2014 Can you extend the discount Dan? Quote Link to post Share on other sites
Pete_UK 9 Posted September 1, 2014 Report Share Posted September 1, 2014 Just signed up Will be watching tonight Roll-on a new bonus video! Quote Link to post Share on other sites
Bot-Factory 602 Posted September 1, 2014 Author Report Share Posted September 1, 2014 Just signed up Will be watching tonight Roll-on a new bonus video! Welcome on board Pete. Any idea for another bonus video? Please remember, it should be a special challenge. Something that hasn't been covered in the tutorials yet. Not just another complicated website Quote Link to post Share on other sites
Pete_UK 9 Posted September 1, 2014 Report Share Posted September 1, 2014 Welcome on board Pete. Any idea for another bonus video? Please remember, it should be a special challenge. Something that hasn't been covered in the tutorials yet. Not just another complicated website Hi Dan, I am focused on Amazon right now (I'm a market place seller), so creating bots to help automate my workload (Listing, repricing etc..). One thing I am going to tackle is working working with the Amazon Seller Central API. I haven't done anything with it at the moment but I guess it boils down to Get/Post requests and dealing with XML etc.., but as far as training videos go this my not be a good topic for everyone as you need an Amazon Seller account. So, a similar topic could be something to do with the Amazon Associates Product Advertising API. I would think the way it works is going to be similar to the seller central way of working, plus it may be a lot more relevant to everyone else as there are lots of people with Amazon associate accounts trying to earn a few pennies as affiliates. Here is the main dev page: https://affiliate-program.amazon.co.uk/gp/advertising/api/detail/main.html and there is the Amazon Scratch Pad that would help build and test requests and view responses here: http://associates-amazon.s3.amazonaws.com/scratchpad/index.html I know this is not strict scraping webpages etc.. but for those sites that provide extensive API's it would (I think) open up doors for Ubot'ers to explore. What you think? Quote Link to post Share on other sites
Bot-Factory 602 Posted September 1, 2014 Author Report Share Posted September 1, 2014 Pete, unfortunately this is not a specific http plugin challenge. This is more about a http bot getting data from amazon. But there are a couple of amazon examples in the http tutorial videos already. The tutorial videos always focus on a very specific challenge. The websites we use are secondary. It's always about how to solve the problem.Like:How do I upload a file with http plugin. How can I extract a cookie if it is hidden with....I can not login to site xyz because it requires a cookie and I can not find it... So I definitely can do another video with the amazon API. But only if there is a very specific problem where you struggle. And before I accept a new tutorial request, I will ask very specific questions. To see if people have at least tried it once Dan Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.