webpro 31 Posted February 20, 2013 Report Share Posted February 20, 2013 Guys, what's the trick to scrape pages which never ends ? Like Pinterest for instance ? Right now i'm working on a site which loads new images when you scroll down and it never stops. Well it does if you stop scrolling down. I have setup the keyword search feature and it goes to work alright but it scrapes 60 pics only. There's no "NEXT PAGE" or anything like it ? I know there's a twist as i saw some guys doing it so.....Can someone spare a little trick for the old musician....lol Quote Link to post Share on other sites
luis carlos 94 Posted February 20, 2013 Report Share Posted February 20, 2013 My trick for the old musician =) Use this code to scroll to the bottom of the page: window.scrollTo(0, document.body.scrollHeight); 2 Quote Link to post Share on other sites
dmbfan 9 Posted February 20, 2013 Report Share Posted February 20, 2013 In a Pinterest Autopinner/Autofillower that I created, I was actually able to avoid the scrolling issue by manipulating the URLs to go directly to the pages. There was pretty clean logic as to how the pages were organized and it was just a matter of cycling through them. Quote Link to post Share on other sites
webpro 31 Posted February 20, 2013 Author Report Share Posted February 20, 2013 I see, well it's not for Pinterest as you all may know, lots of sites are using this kind of display. I'll try your ideas guys thanks a lot. If you got other ideas, shoot please. This can't hurt ! Quote Link to post Share on other sites
webpro 31 Posted February 21, 2013 Author Report Share Posted February 21, 2013 Ok it's working guys Thanks Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.