Jump to content
UBot Underground

[help] me in figuring out how to scrape data from facebook


Recommended Posts

I posted this before but I made a bot to go to facebook and search for a word thus giving me a list of pages. I want to scrape those pages into a list and capture each one. My code is:

 

 

type text(<aria-label="search">, #search, "Standard")

clear list(%pages)

add list to list(%pages, $scrape sttribute(<class="text">, fullhref"), "Delete", "Global")

 

but when it scrapes the data it only gives me one link and not all the links. This is all happening within a javascript window, I presume. Any help will be much appreciated! I am including screen shots to show you what I mean. 

 

Yes I know this post is identical to my last one but I need help badly. 

post-9165-0-27118400-1365811885_thumb.png

post-9165-0-21277100-1365811889_thumb.png

post-9165-0-27992800-1365811893_thumb.png

post-9165-0-98478800-1365811896_thumb.png

Link to post
Share on other sites

Don't use the built in search at the top, you're better off navigating to pages like this 

https://www.facebook.com/search/results.php?q=[search term]&type=groups&init

 

That ones for groups, there's also pages. 

 

add list to list(%pages, $scrape attribute(<href=w"/groups/*/">, "fullhref"), "Delete", "Global")

 

Then something like this will scrape the group pages. In this example I'm using a wild card designated by the *. 

For pages use the search page :

 

https://www.facebook.com/search/results.php?q=[search term]type=pages&init

 

and this will reliably scrape the page :

 

add list to list(%groups, $scrape attribute(<data-hovercard=w"/ajax/hovercard/page.php?id=*">, "fullhref"), "Delete", "Global")

  • Like 1
Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
×
×
  • Create New...