Yagami 1 Posted November 20, 2017 Report Share Posted November 20, 2017 Hi, I'm trying to scrape only profiles that have more than 1k followers, but I can't see how to do that. A little help would be appreciated. Here is what it looks like on the page followed by the html code of an offset. <div> <div class="_0 _3i _2m _kq _ll"> <div class="_0 _3i _2m _2f"> <a href="/lovely_cat_dogs/" rel=""> <div class="_0 _3i _2m"> <div class="_0 _3i _2m _2f" style="width: 100%;"> <div class="_mm _29 _2f _mp _53"> <div class="_0 _3i _2m _2f" style="background-color: rgb(239, 239, 239); padding-bottom: 100%;"> <img alt="We Are Cat, Dog Lovers" class="_mi _25 _3w _2h" src="https://s-media-cache-ak0.pinimg.com/avatars/smarttshirt_1477233185_280.jpg"> </div> <div class="_mq _2h _2k _2l _2j _2i"> </div> </div> </div> <div class="_0 _3i _2m _6u"> <div class="_0 _3i _2m _11 _3w _2 _2v _35 _6o"> <div class="_st _ss _su _sl _5j _sm _sq _nw _nx _ny _nz _sr">We Are Cat, Dog Lovers</div> </div> <div class="_st _ss _sw _sk _5j _sm _sq _no _np _nq _nr"> <!-- react-text: 1327 --> <!-- /react-text --> <!-- react-text: 1328 -->8<!-- /react-text --> <!-- react-text: 1329 --> boards<!-- /react-text --> <!-- react-text: 1330 --> • <!-- /react-text --> <!-- react-text: 1331 --> <!-- /react-text --> <!-- react-text: 1332 -->1.1k<!-- /react-text --> <!-- react-text: 1333 --> followers<!-- /react-text --> </div> </div> </div> </a> <div class="_t9 _2h _55"> </div> </div> </div> </div> Thank you, Edit: Here is how I scrape the profile add list to list(%searchlist,$scrape attribute(<href=w"/*/">,"href"),"Delete","Global") Quote Link to post Share on other sites
Yagami 1 Posted November 20, 2017 Author Report Share Posted November 20, 2017 So, I scraped the class of the offsets that I have now in a list. How can I scrape each row of this list in a table (row 0 is usernames and row 1 is followers # )? Quote Link to post Share on other sites
pash 504 Posted November 20, 2017 Report Share Posted November 20, 2017 post your code include website url. Quote Link to post Share on other sites
Yagami 1 Posted November 20, 2017 Author Report Share Posted November 20, 2017 This is the code I use to scrape the page (I have another js script for scrolling) add list to list(%searchlist,$scrape attribute(<href=w"/*/">,"href"),"Delete","Global") The site I try to scrape is Pinterest followers pages (click on any profile, click on followers and there you are). Thank you Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.