zdot 14 Posted February 4, 2013 Report Share Posted February 4, 2013 cool stuff. Greatwork Aymen Quote Link to post Share on other sites
matflawless 7 Posted February 4, 2013 Report Share Posted February 4, 2013 Looks cool By the way, Lindexed and The Best Spinner APIs will be supported? ThanksMat Quote Link to post Share on other sites
Kreatus (Ubot Ninja) 422 Posted February 4, 2013 Report Share Posted February 4, 2013 Nice.. Getting this now. Quote Link to post Share on other sites
Aymen 385 Posted February 4, 2013 Author Report Share Posted February 4, 2013 Looks cool By the way, Lindexed and The Best Spinner APIs will be supported? ThanksMatYes , i'm integrating them , but anybody that have this plugin can try to integrate any API they want, allthey need is the URL and the POST data Quote Link to post Share on other sites
Aymen 385 Posted February 4, 2013 Author Report Share Posted February 4, 2013 Updates :-New video added to the thread to demonstrate how page scraper and file downloader commands works-updates the ubot source codes-added the sockets google scraper example to the source codes list Quote Link to post Share on other sites
HelloInsomnia 1103 Posted February 4, 2013 Report Share Posted February 4, 2013 Just bought, checking it out now! Quote Link to post Share on other sites
HelloInsomnia 1103 Posted February 4, 2013 Report Share Posted February 4, 2013 Okay this is pretty cool I did some comparison tests to see if its faster and if so by how much. I ran through a list of 14 sites and gathered all the emails in there (about 2,500) - this seems like it would be perfect for this kind of thing. The fastest I could possibly get it normally using the browser was 11 seconds - but I had issues where 1 out of the 3 times it skipped one of the pages with tons of emails on it since the page loaded instantly then scraped all the data. The fastest I got it using this plugin was 4 seconds - thats 14 pages and 2,500 emails scraped in 4 seconds - and no hiccups either - even for simple things like this to me its well worth the price. 2 Quote Link to post Share on other sites
Aymen 385 Posted February 4, 2013 Author Report Share Posted February 4, 2013 Okay this is pretty cool I did some comparison tests to see if its faster and if so by how much. I ran through a list of 14 sites and gathered all the emails in there (about 2,500) - this seems like it would be perfect for this kind of thing. The fastest I could possibly get it normally using the browser was 11 seconds - but I had issues where 1 out of the 3 times it skipped one of the pages with tons of emails on it since the page loaded instantly then scraped all the data. The fastest I got it using this plugin was 4 seconds - thats 14 pages and 2,500 emails scraped in 4 seconds - and no hiccups either - even for simple things like this to me its well worth the price. Thank you for the feedback , Glad you like it Quote Link to post Share on other sites
P0s3id0n 90 Posted February 4, 2013 Report Share Posted February 4, 2013 Humm I got a question and I am sorry if I am over thinking here. With this or any Ubot plugin. Will the plugin work on the compiled bot with out needing the .dll file? Or We have to provided that file along with the .exe to our customers? Quote Link to post Share on other sites
Aymen 385 Posted February 4, 2013 Author Report Share Posted February 4, 2013 Humm I got a question and I am sorry if I am over thinking here. With this or any Ubot plugin. Will the plugin work on the compiled bot with out needing the .dll file? Or We have to provided that file along with the .exe to our customers?no you won't need the dll files on the compiled bots Quote Link to post Share on other sites
AutomationNinja 194 Posted February 4, 2013 Report Share Posted February 4, 2013 Nice one Aymen. Looks to be quite the stellar plugin. Quote Link to post Share on other sites
VentureOnline 49 Posted February 4, 2013 Report Share Posted February 4, 2013 Mm. You seem to know a lot about hidden bot traps like these hidden keys or whatever you're talking about which I have no clue what they are. Howabout opening a thread on this subject debating what hidden keys or traps which website has set ? Your thread could shoot-off, you know!I'd gladly read it to learn a lot of secrets of some websites that use to foil bots. So, what-about a thread ? Who knows you might one day be able to build an ebook out of it (if you hold the best parts back from the thread) and sell it to other Ubotters who'd want to just read your infos and be aware of all the bot traps. I don't promise anyone would buy it though but you never know. As for me, I'm looking forward to that thread so I can get all your info for free! Now, I've got you thinking, haven't I ? You probably should've thought of this opportunity before. You never know, maybe there are a lot of Ubotters facing difficulty building bots to work on some sites as they're getting foiled and they don't know what's causing these because they're probably not aware (just like I wasn't) about these hidden keys. And, if a lot of websites start adding these hidden keys then a lot of Ubot built bots would start malfunctioning and their vendors getting a lot of customer complaints going crazy. They might buy your ebook just to save time and learn the foiling techniques of each site quick so they can update their bots fast. You can always open a thread to help other Ubotters if they suddenly started getting customer complaints because their bots don't work and the Ubotters are frustrated unable to findout what's wrong. You can offer them help with your "hidden key" or "hidden danger awareness" knowledge and fix their bots and charge them a little. You might even charge them a monthly little fee for an ongoing income. You never went that much into thinking, did you ? I just thoughtup all this while typing in 5 mins!Mmm. This is starting to give me some dieas now. Must do some form of deals with other Ubotters and build a steady income. Good idea. Just make sure whatever you do earn from these ventures, to split 50% of your profits with me. After-all, I did suggest the idea. Now, you got to think whether I'm kidding or serious.These hidden elements are only an issue when dealing with HTTP post requests. This does not affect ubot since ubot is browser based. Anyone who does web automation using post requests already knows about this so there's nothing really to show people. Quote Link to post Share on other sites
Bliss 194 Posted February 5, 2013 Report Share Posted February 5, 2013 I bought this off Aymen the day of release.. I used it yesterday in a bot.. WOW it's fast. I got to say that if you are thinking about grabbing this then do so fast before he puts the price up It will save you so much time and messing about, its easy to use and the things it can be used for is endless. Loving it! Keep up the great work Aymen 1 Quote Link to post Share on other sites
Aymen 385 Posted February 5, 2013 Author Report Share Posted February 5, 2013 Updates : -HTTP Proxy Checker Function added-Proxy Checker ubot source code added contact me to get the update Quote Link to post Share on other sites
matflawless 7 Posted February 5, 2013 Report Share Posted February 5, 2013 ouch I did wait too much and the price has been already increased... /me slap myself 1 Quote Link to post Share on other sites
gandensang 11 Posted February 5, 2013 Report Share Posted February 5, 2013 just purcase this pluginand its rock....sure its make me happy to coding.. waiting your next plugin bro Quote Link to post Share on other sites
Frank 177 Posted February 5, 2013 Report Share Posted February 5, 2013 I'd like to see this working with an api. Frank Quote Link to post Share on other sites
Aymen 385 Posted February 5, 2013 Author Report Share Posted February 5, 2013 I'd like to see this working with an api. FrankHey Frank,so far it works with ,SpinnerChief , Linklicious , SpinRewriter , Lindexed !waiting to get a subscription for the best spinner to access their API documentation !but in general it works with most of the API services Quote Link to post Share on other sites
abbas786 78 Posted February 5, 2013 Report Share Posted February 5, 2013 Great Job Aymen ! Does it supports proxies, cookies and threading with local variable support ? Quote Link to post Share on other sites
Aymen 385 Posted February 5, 2013 Author Report Share Posted February 5, 2013 Great Job Aymen ! Does it supports proxies, cookies and threading with local variable support ?Not for now , but i have those planned to be added in the next updates 1 Quote Link to post Share on other sites
abbas786 78 Posted February 6, 2013 Report Share Posted February 6, 2013 Not for now , but i have those planned to be added in the next updates OK, will wait for ur updates with these features, count me in 1 Quote Link to post Share on other sites
Aymen 385 Posted February 6, 2013 Author Report Share Posted February 6, 2013 Updates : -Added Source Code For The Best Spinner API Integration (Many Thanks to HelloInsomnia for working on this) Quote Link to post Share on other sites
AutomationNinja 194 Posted February 6, 2013 Report Share Posted February 6, 2013 woop woop! pretty awesome stuff Aymen. your a ninja! Quote Link to post Share on other sites
Aymen 385 Posted February 8, 2013 Author Report Share Posted February 8, 2013 Updates:-Wp commenter Added (Uses the http post plugin) in this example i demonstrate how to get hidden fields from comments pages A tip : if you want to get a hidden field in a page then all what you have to do is scrape the page the first time then find all the hidden fields you want using regex , after that you add those hidden fields to the http post request and you send it to the server , same thing goes with captchas , if you don't know what to send ( in case of a hidden field) then scrape the page and get everything you want , then send again ! In case of a hiddeen field that changes everytime you load the page ,wouldn't the hidden field change when you attempt to send the Post data the second time ?? well the HTTP request happens before the page loads , example process :Send first request => Get page html => Send http Post data =>get result html Hope this helps a bit to andrestand how HTTP requests works 1 Quote Link to post Share on other sites
VentureOnline 49 Posted February 8, 2013 Report Share Posted February 8, 2013 Any chance you could show a video of maybe creating an account on Tumblr for example? Since this is one of those sites where you need to do an initial scrape to get hidden form elements as well as a captcha. Im used to PHP Curl needing to set cookies and what not but im curious to see if this is possible without needing that. Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.