webpro 31 Posted November 11, 2013 Report Share Posted November 11, 2013 Any ideas why i'm stuck to 50 urls scraped ? clear list(%urls) add list to list(%urls, $scrape attribute(<class="url-link">, "fullhref"), "Delete", "Global") I use this scrolling code and it works fine (it's a page like Pinterest) Last time i tried, i used 10 scrolls loop(#scrollnumber) { run javascript("window.scrollTo(0, document.body.scrollHeight);") wait(10) } It did scroll 10 times and i got lots of images but i just get the first 50 urls in the debugger ? No matter how many times i scroll down ?It refuses to scrape past the first 50 ? Quote Link to post Share on other sites
luis carlos 94 Posted November 12, 2013 Report Share Posted November 12, 2013 Did you check <class="url-link"> for the next 50 urls? Quote Link to post Share on other sites
LoWrIdErTJ - BotGuru 904 Posted November 12, 2013 Report Share Posted November 12, 2013 likely changes class?some have hidden attributes in some sites that you must hover an item to show and make available the urls as well. Quote Link to post Share on other sites
Ebizon 0 Posted December 17, 2013 Report Share Posted December 17, 2013 likely changes class?some have hidden attributes in some sites that you must hover an item to show and make available the urls as well.can you describe me how i scrab the url in all pages after search in google search.how can i go next to next page until end of page.please give me solution of that kind of problem.i am not able to get solution of this..? Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.