Interesting Scrape Issue, could use a bit of help

[automaton 2]

Hello all!  I have a Scrape routine I have been running for th last year which worked great up until very recently.  The scrape pulls a list of groups for a user from Facebook.  The problem I am running into, is the site changed how they list the groups.  I used to run the scrape attribute for the page and that would pull the information I needed.  Now their is no defined "page", as you scroll down more and more elements get added on so that the page "grows"...Now I can't figure out how to get the entire list...My scrape only pulls the first 60 or so records.

 

Has anyone run into this kind of issue before?

 

Any help would be greatly appreciated.

 

[Steve 30]

you can use javascript to scroll to the bottom of the page...  here's an example: http://www.ubotstudio.com/forum/index.php?/topic/10245-scroll-to-bottom/

[automaton 2]

you can use javascript to scroll to the bottom of the page...  here's an example: http://www.ubotstudio.com/forum/index.php?/topic/10245-scroll-to-bottom/

Thanks Steve, you are a life savor!  =)

[Steve 30]

glad I could help  

[brusacco 20]

That works great ... I use it to scrape Facebook Pages, Groups, Profiles ...etc.

window.scrollTo(0,document.body.scrollHeight);