automaton 2 Posted March 20, 2014 Report Share Posted March 20, 2014 Hello all! I have a Scrape routine I have been running for th last year which worked great up until very recently. The scrape pulls a list of groups for a user from Facebook. The problem I am running into, is the site changed how they list the groups. I used to run the scrape attribute for the page and that would pull the information I needed. Now their is no defined "page", as you scroll down more and more elements get added on so that the page "grows"...Now I can't figure out how to get the entire list...My scrape only pulls the first 60 or so records. Has anyone run into this kind of issue before? Any help would be greatly appreciated. Quote Link to post Share on other sites
Steve 30 Posted March 20, 2014 Report Share Posted March 20, 2014 you can use javascript to scroll to the bottom of the page... here's an example: http://www.ubotstudio.com/forum/index.php?/topic/10245-scroll-to-bottom/ 1 Quote Link to post Share on other sites
automaton 2 Posted March 20, 2014 Author Report Share Posted March 20, 2014 you can use javascript to scroll to the bottom of the page... here's an example: http://www.ubotstudio.com/forum/index.php?/topic/10245-scroll-to-bottom/Thanks Steve, you are a life savor! =) Quote Link to post Share on other sites
Steve 30 Posted March 20, 2014 Report Share Posted March 20, 2014 glad I could help Quote Link to post Share on other sites
brusacco 20 Posted March 20, 2014 Report Share Posted March 20, 2014 That works great ... I use it to scrape Facebook Pages, Groups, Profiles ...etc. window.scrollTo(0,document.body.scrollHeight); Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.