Jump to content
UBot Underground

Can't scrape more than 50 profile urls (page like pinterest)


Recommended Posts

Any ideas why i'm stuck to 50 urls scraped ?

clear list(%urls)
add list to list(%urls, $scrape attribute(<class="url-link">, "fullhref"), "Delete", "Global")

I use this scrolling code and it works fine (it's a page like Pinterest) Last time i tried, i used 10 scrolls

loop(#scrollnumber) {
    run javascript("window.scrollTo(0, document.body.scrollHeight);")
    wait(10)
}

It did scroll 10 times and i got lots of images but i just get the first 50 urls in the debugger ? No matter how many times i scroll down ?

It refuses to scrape past the first 50 ?

Link to post
Share on other sites
  • 1 month later...

likely changes class?

some have hidden attributes in some sites that you must hover an item to show and make available the urls as well.

can you describe me how i scrab the url in all pages after search in google search.how can i go next to next page until end of page.please give me solution of that kind of problem.i am not able to get solution of this..?

Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
×
×
  • Create New...