BigEfromDaBX 25 Posted February 19, 2017 Report Share Posted February 19, 2017 Before I would used websta.me to scrape followers and followings for a user. Now I cant do it with that site or the other sites that used to use . So now I have to use instagram but instagram pops up a window that I have to scroll all the way down to before I can grab the code and parse it. So is there another website I can use for this to scrape or should I just use instagram and scroll down? All I need to know is how to scroll all the way down. I already know how to parse it with regex. The list is on a popup. See snapshot. Quote Link to post Share on other sites
BigEfromDaBX 25 Posted February 21, 2017 Author Report Share Posted February 21, 2017 Anybody? Quote Link to post Share on other sites
deliter 203 Posted February 21, 2017 Report Share Posted February 21, 2017 use the instagram api with a http get, havnt used it in a year but google it, much easier than anything else 1 Quote Link to post Share on other sites
BigEfromDaBX 25 Posted February 21, 2017 Author Report Share Posted February 21, 2017 use the instagram api with a http get, havnt used it in a year but google it, much easier than anything elseIm guessing the http get is from Aymens http post? Quote Link to post Share on other sites
deliter 203 Posted February 21, 2017 Report Share Posted February 21, 2017 https://www.instagram.com/developer/endpoints/users/a few ways of doing it, can use the socket commands too, can even load the page in your browser you need an access token, can either fill out the application to get one, or simply get one from an alternative site http://instagram.pixelunion.net/then simply put this in your browser, replacing user-id with their id and replace the access token at the end, at the top of that developer page theres a few other features like searching names etc, really good stuff https://api.instagram.com/v1/users/{user-d}/followed-by?access_token=ACCESS-TOKEN https://api.instagram.com/v1/users/{user-id}/follows?access_token=ACCESS-TOKEN 1 Quote Link to post Share on other sites
BigEfromDaBX 25 Posted February 21, 2017 Author Report Share Posted February 21, 2017 (edited) https://www.instagram.com/developer/endpoints/users/a few ways of doing it, can use the socket commands too, can even load the page in your browser you need an access token, can either fill out the application to get one, or simply get one from an alternative site http://instagram.pixelunion.net/then simply put this in your browser, replacing user-id with their id and replace the access token at the end, at the top of that developer page theres a few other features like searching names etc, really good stuff https://api.instagram.com/v1/users/{user-d}/followed-by?access_token=ACCESS-TOKEN https://api.instagram.com/v1/users/{user-id}/follows?access_token=ACCESS-TOKENThanks @deliter From what I have researched, you cant get users followers anymore. See here: https://www.instagram.com/developer/endpoints/relationships/. Ifinally got my Access token and was able to use the api on for getting info on myself but for everything else you have to add Login Permissions (Scopes). In order to do that you have to get the app approved. Is that hard to get approved or am I doing something wrong? Edited February 21, 2017 by BigEfromDaBX 1 Quote Link to post Share on other sites
deliter 203 Posted February 21, 2017 Report Share Posted February 21, 2017 I'l take a look later, but has to work maybe I am forgetting something Quote Link to post Share on other sites
deliter 203 Posted February 21, 2017 Report Share Posted February 21, 2017 yeah that sucks alright go herehttps://elfsight.com/blog/2016/05/how-to-get-instagram-access-token/ get the access token, and you'l see in the access panel of your developer console, permission, tick all the boxes, and submit to get granted access,you'l need to give instagram contact information too Quote Link to post Share on other sites
deliter 203 Posted February 21, 2017 Report Share Posted February 21, 2017 done a little research, dude you got to the bottom of that fast, took me an hour before coming to your conclusion, this really sucks about a year ago could make really nice bots with this data, oh well I do however have a code I posted at some point to scroll through a pop up if that might help get the followers, posted some code for scrolling through a Agree to T&C's of a google pop up sometime in the last year 1 Quote Link to post Share on other sites
BigEfromDaBX 25 Posted February 21, 2017 Author Report Share Posted February 21, 2017 (edited) done a little research, dude you got to the bottom of that fast, took me an hour before coming to your conclusion, this really sucks about a year ago could make really nice bots with this data, oh well I do however have a code I posted at some point to scroll through a pop up if that might help get the followers, posted some code for scrolling through a Agree to T&C's of a google pop up sometime in the last year Hey Deliter. Thanks for the help anyways. I found this article http://stackoverflow.com/questions/36265861/instagram-api-get-the-list-of-instagram-users-this-user-is-followed-by that mentioned you couldnt do that anymore. Sucks big time. I wanted to do it through the API sooooooo bad lol. My first API attempt lol. Its all good. If you can post the the code to scroll down that popup for me that would be great Thanks Edited February 21, 2017 by BigEfromDaBX Quote Link to post Share on other sites
deliter 203 Posted February 21, 2017 Report Share Posted February 21, 2017 let me know if this works, works on my browser, dont know if the tags name are generated dynamically loop(10) { run javascript("document.querySelector(\"._4gt3b\").scrollTop +=document.querySelector(\"._4gt3b\").scrollHeight") wait(3) } click the box for the followers and run this 2 Quote Link to post Share on other sites
BigEfromDaBX 25 Posted February 21, 2017 Author Report Share Posted February 21, 2017 I didnt know you can run javascript right from the browswer. so i google it for chrome. Didnt work for me See snapshot. Quote Link to post Share on other sites
deliter 203 Posted February 21, 2017 Report Share Posted February 21, 2017 no put that code into ubot not the browser, run like any other ubot script Quote Link to post Share on other sites
luis carlos 94 Posted February 21, 2017 Report Share Posted February 21, 2017 I tried the code, but does not work on my end. Where can I take the tag name from? seems they change every time. Thanks a lot Luis Carlos 2 Quote Link to post Share on other sites
deliter 203 Posted February 21, 2017 Report Share Posted February 21, 2017 ok will try something different, 5 minutes 2 Quote Link to post Share on other sites
deliter 203 Posted February 21, 2017 Report Share Posted February 21, 2017 did you try this when the dialog pop up was open displaying the follows/followers? just tried logging out clearing cookies, still works Quote Link to post Share on other sites
luis carlos 94 Posted February 21, 2017 Report Share Posted February 21, 2017 did you try this when the dialog pop up was open displaying the follows/followers? just tried logging out clearing cookies, still worksYes, when the dialog is open.... I tried it with my own followers, and from other profile too, but the window does not scroll. Quote Link to post Share on other sites
BigEfromDaBX 25 Posted February 21, 2017 Author Report Share Posted February 21, 2017 I tri let me know if this works, works on my browser, dont know if the tags name are generated dynamically loop(10) { run javascript("document.querySelector(\"._4gt3b\").scrollTop +=document.querySelector(\"._4gt3b\").scrollHeight") wait(3) } click the box for the followers and run this I tried also. Didnt work for me either. Tried with both followers and followings popup windows. Quote Link to post Share on other sites
deliter 203 Posted February 21, 2017 Report Share Posted February 21, 2017 try this if this doesnt work in Ubot 5.9 Chrome 49, click view, click web inspector,open the dialog on screen, and click the element selector in the web inspector and click on the top of the dialog, the black border that surrounds it, and in the element selector under Elements, should start with a role="dialog" right click copy HTML and post it on pastebin the HTML loop(10) { run javascript("document.querySelector(\"[role=\'dialog\'] div:nth-child(2) div div:nth-child(2)\").scrollTop +=document.querySelector(\"[role=\'dialog\'] div:nth-child(2) div div:nth-child(2)\").scrollHeight") wait(3) } 2 Quote Link to post Share on other sites
luis carlos 94 Posted February 21, 2017 Report Share Posted February 21, 2017 I was using broswer 21, and that was the reason because the first code did not work. I change to brower 49, and both work perfect Thank you so much! Quote Link to post Share on other sites
BigEfromDaBX 25 Posted February 22, 2017 Author Report Share Posted February 22, 2017 try this if this doesnt work in Ubot 5.9 Chrome 49, click view, click web inspector,open the dialog on screen, and click the element selector in the web inspector and click on the top of the dialog, the black border that surrounds it, and in the element selector under Elements, should start with a role="dialog" right click copy HTML and post it on pastebin the HTML loop(10) { run javascript("document.querySelector(\"[role=\'dialog\'] div:nth-child(2) div div:nth-child(2)\").scrollTop +=document.querySelector(\"[role=\'dialog\'] div:nth-child(2) div div:nth-child(2)\").scrollHeight") wait(3) } Here you go. Do we select the class with the red arrow (_q44m8 _7z4zb) that is the header of that popup or the class right above it (_n3cp9 _qjr85) which is the whole popup? Quote Link to post Share on other sites
deliter 203 Posted February 22, 2017 Report Share Posted February 22, 2017 Here you go. Do we select the class with the red arrow (_q44m8 _7z4zb) that is the header of that popup or the class right above it (_n3cp9 _qjr85) which is the whole popup? Change browser to Chrome 49 in settings, should work fine, both CSS Selectors will work for that HTML, Luis Carlos got the script working by changing to chrome 49 Quote Link to post Share on other sites
BigEfromDaBX 25 Posted February 22, 2017 Author Report Share Posted February 22, 2017 Change browser to Chrome 49 in settings, should work fine, both CSS Selectors will work for that HTML, Luis Carlos got the script working by changing to chrome 49 Im always in chrome49. Didnt work for me. run javascript("loop(10) \{ run javascript(\"document.querySelector(\\\"[role=\\\'dialog\\\'] div:nth-child(2) div div:nth-child(2)\\\").scrollTop +=document.querySelector(\\\"[role=\\\'dialog\\\'] div:nth-child(2) div div:nth-child(2)\\\").scrollHeight\") wait(3) \}") Quote Link to post Share on other sites
deliter 203 Posted February 22, 2017 Report Share Posted February 22, 2017 MiriamMB I see your on here, might pass some feedback about this "Daily Quota" for likes, thats pretty unbelievable, Ive often thought nobody likes my posts, maybe they dont, but if you only have around 5 likes a day you cant give away too many, this is deflating to contributors, you like to know your posts are actually being read and appreciated especially when you put some effort into them 2 Quote Link to post Share on other sites
deliter 203 Posted February 22, 2017 Report Share Posted February 22, 2017 Im always in chrome49. Didnt work for me. run javascript("loop(10) \{ run javascript(\"document.querySelector(\\\"[role=\\\'dialog\\\'] div:nth-child(2) div div:nth-child(2)\\\").scrollTop +=document.querySelector(\\\"[role=\\\'dialog\\\'] div:nth-child(2) div div:nth-child(2)\\\").scrollHeight\") wait(3) \}") the code you posted above certainly doesnt work, that is not what I posted see all the extra back slashes in it \\\ dont know how you changed it but copy it again from my original post, and not this broken formatted code above and paste directly into the ubot code editor Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.