ayhoung 0 Posted April 25, 2013 Report Share Posted April 25, 2013 Hi guys! Wondering if there's a good solution to deal with infinite scrolling pages? I want to scrape links and titles but I'm not getting all of them due to an ajax-based infinite scroll (a la pinterest). Noobie here, so if you guys have a good solution, please let me know! Thanks Allen Quote Link to post Share on other sites
north_star 16 Posted April 25, 2013 Report Share Posted April 25, 2013 run java scriptand then insert this code window.scrollTo(0,document.body.scrollHeight); you can loop above process while scraping proscess is executed 2 Quote Link to post Share on other sites
kev123 132 Posted April 25, 2013 Report Share Posted April 25, 2013 Im wondering if theres a way to do this with the http plugin Quote Link to post Share on other sites
NewTechLife 3 Posted May 13, 2013 Report Share Posted May 13, 2013 Thanks for this. I have been looking for a solution for the same problem Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.