Jump to content
UBot Underground

Scraping Linkedin Search Results Suddenly Stopped Working? (Scrape Element Locks Up Ubot!)


Recommended Posts

I've got a bot that scrapes search results from LinkedIn search (scrapes people's names). It worked fine, but now it doesn't. Looks like classnames in the LI search source changed or something, which SHOULD be an easy fix, however...

 

When I navigate to a LinkedIn search results page in the uBot browser (through the navigate node), then try to set a scrape attribute, when I click on the <> symbol to scrape the attribute, uBot locks up :(

 

I've tried this with an existing bot and also starting from scratch with a VERY minimal bot doing just this... Same result :( (switched to Firefox 6 on both bots as the UA).

 

I also tried scraping elements on other URLs, all works fine.

 

I submitted a support ticket yesterday too, but thought I'd post here in case anyone had any ideas?

 

Cheers!

 

 

Link to post
Share on other sites

Try switching browsers first, Tools -> Options -> Change the browser then restart Ubot.

 

If that doesn't work then (change back to previous browser) use something like Chrome web inspector and manually write the selector code needed - I know this isn't ideal but Ubot will probably still work properly if you put in the right code, if you need help I'm sure somebody can help you with it.

Link to post
Share on other sites

Try switching browsers first, Tools -> Options -> Change the browser then restart Ubot.

 

If that doesn't work then (change back to previous browser) use something like Chrome web inspector and manually write the selector code needed - I know this isn't ideal but Ubot will probably still work properly if you put in the right code, if you need help I'm sure somebody can help you with it.

Thanks! I'll try this later

Link to post
Share on other sites

Ahhh interesting! Hmmm odd though, as my bot worked only 4 weeks ago! (but this post was from Sept). Have you had any joy since that post? (will be afk for an hour or so now, so excuse any slow response).

Edited by MikeTheMike
Link to post
Share on other sites

Nope - tried both of the recommendations. With the older Chrome browser, it fails to load the page after logging in.

 

With the other one, it locks up as soon as I click on <> on scrape attribute OR right-click on the browser window. With regards inspecting in Chrome manually, I can do that but it then fails to scrape - In fact it seems bestmacros has already mentioned this back in September: http://network.ubotstudio.com/forum/index.php/topic/21272-unable-to-interact-with-linkedin-page/?p=130684

 

Does uBot not work scraping LinkedIn search results without the exbrowser add-on now then? Also, can I ask the estimated wait time for support tickets? I submitted a ticket yesterday and haven't had a reply yet, just wondered if there's an estimated time on replies to tickets.

 

Anything else I can try? I have the dev version, anything in that which could help with this scenario?

Thanks.

 

 

Try switching browsers first, Tools -> Options -> Change the browser then restart Ubot.

 

If that doesn't work then (change back to previous browser) use something like Chrome web inspector and manually write the selector code needed - I know this isn't ideal but Ubot will probably still work properly if you put in the right code, if you need help I'm sure somebody can help you with it.

Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
×
×
  • Create New...