Ptrick125 45 Posted December 21, 2013 Report Share Posted December 21, 2013 I'm working on a Google images scraper that I plan on selling the source code to, and I was looking for beta testers to test out the compiled version that I have so far. https://www.dropbox.com/s/mhpdfavejlxpwoo/Google%20Image%20Scraper%20Beta.exe http://gyazo.com/b41c599680001be9e2b70e90d40d0de6.png http://gyazo.com/72e65a98c0d98396d4c8ffbe716da4c0.png 1 Quote Link to post Share on other sites
Edward_2 85 Posted December 21, 2013 Report Share Posted December 21, 2013 Google Images I found to be a real beach to automate, Good work bro. A Video would go a long way to promote your bot. Quote Link to post Share on other sites
the_way 52 Posted December 22, 2013 Report Share Posted December 22, 2013 does it download the full size of the image from the associated website or google cache? Quote Link to post Share on other sites
Ptrick125 45 Posted December 22, 2013 Author Report Share Posted December 22, 2013 does it download the full size of the image from the associated website or google cache? With the current version using a Android User Agent, Google tends to serve smaller pictures, but it downloads the fullest size and resolution that is in the Google database. Quote Link to post Share on other sites
Ptrick125 45 Posted December 22, 2013 Author Report Share Posted December 22, 2013 Google Images I found to be a real beach to automate, Good work bro. A Video would go a long way to promote your bot. It definitely is Thanks for the suggestion! Since it is one of my higher end source codes, I'll probably make a whiteboard video and a screencast video for it. Quote Link to post Share on other sites
illmill 87 Posted December 22, 2013 Report Share Posted December 22, 2013 Awesome work, P! Thanks for the free download. It works great, but if I may offer a few points of improvement (since this is beta and all). On the scraper tab, rather than have "next page" which people have to click have either a dropdown or text box with the number of pages to scrape. People will always want to scrape more than one page and it's not very user friendly to click next page 20 times. In fact, I wouldn't recommend having two tabs for this at all. There's no point in scraping without downloading, so they should both happen on the same tab. Since your'e going to sell the source code, just split them up by putting them into different defines. With all that being said, I know how hard it is to scrape images from google, so really good work on this! It would be cool if there was a way to get the full size images. I used to have a bot that did this beautifully, but google changed the way they do their links and now it seems impossible. Do they still give you the option on google images to search for images of a certain size? Anyway, good work, man.... Ninja Edit: is there a way to download jpeg files instead of png? I usually need jpegs. Is this because you're doing it from the android user agent? Of course, I could always convert in batches with photoshop, but the less work i have to do the better Quote Link to post Share on other sites
Ptrick125 45 Posted December 22, 2013 Author Report Share Posted December 22, 2013 Awesome work, P! Thanks for the free download. It works great, but if I may offer a few points of improvement (since this is beta and all). On the scraper tab, rather than have "next page" which people have to click have either a dropdown or text box with the number of pages to scrape. People will always want to scrape more than one page and it's not very user friendly to click next page 20 times. In fact, I wouldn't recommend having two tabs for this at all. There's no point in scraping without downloading, so they should both happen on the same tab. Since your'e going to sell the source code, just split them up by putting them into different defines. With all that being said, I know how hard it is to scrape images from google, so really good work on this! It would be cool if there was a way to get the full size images. I used to have a bot that did this beautifully, but google changed the way they do their links and now it seems impossible. Do they still give you the option on google images to search for images of a certain size? Anyway, good work, man.... Ninja Edit: is there a way to download jpeg files instead of png? I usually need jpegs. Is this because you're doing it from the android user agent? Of course, I could always convert in batches with photoshop, but the less work i have to do the better Thank you for the responses Good idea on the two tabs and the button for next page, I can probably throw in a dropdown for how many pages they want to go through. Scraping the images was definitely a pain. I may switch it over to a desktop user agent because Google serves smaller images to smaller devices, but the images were full size when downloading them. Yes, I personally set it up to download as .Png but I could have a dropdown with the save file type so you can customize it. Thank you everyone for the responses! I will be updating it within the next few days after I roll out my instagram bot that likes, comments, and downloads (PM me if you want to beta test) Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.