I'm not sure if anyone has been able to do this.. But I have been trying to scrape Insta insights using the Content Studio option provided by FB..
I've taken a screenshot of this (though you might have tolog in via your own account to see the HTML code and stuff)
123.png 84.75KB 0 downloads
The problem I'm having with this is as follows:
1. Lazy load - When first loaded, uBOT only picks up the posts that are visible on the screen due to lazy loading. But if I scroll down either manually (or via run
, what happens is that the top half of posts now disappear and gets hidden out of view from the HTML so again uBOT's $scrape attribute doesnt pick it up - it only sees ~5- visible posts at a time (ideally I'd want to scrape all 30-50 posts that I have in one shot)...
2. Also,I'm using the $scrape attribute feature for the scrapping. Since everything appears visually like a table, in reality the HTML/css is only <div's> rather than an HTML table so uBot doesnt recognize it with $scrape_table. Hence I have to scrape separately the post headings in one list, dates in another list, then the likes + comments in 3rd list and then due to the lazy load from the earlier point I have to manually see if there are any duplicated entries and take them out...
Is there a fast way to scrape: Name of post, datetime,likes,comments as column headings & then the data for each of them?