webpro 31 Posted January 24, 2013 Report Share Posted January 24, 2013 I don't know why it's doing this now ? If the bot clicks on Next>>to go to the next page, it always skips a page to scrape ? Ex: 1,3,5,7,9,11 etc....Will get scrapped and not 2,4,6,8 etc....Wasn't doing this before and i ain't using the increment command ?Odd ? Does this ever happened to you ? loop while($exists($element offset(<tagname="span">, 6))) { add list to list(%urllist, $scrape attribute(<outerhtml=w"<a href=\"/profile.html?view=mini&uid=*&src=obr\" class=\"user_img\" onclick=\"return tagged.search.results.fillParamForm(*, *, \'/profile.html?view=mini&uid=*&src=obr\');\"> <img height=\"120px\" width=\"120px\" src=\"*\" alt=\"*\"> </a>">, "fullhref"), "Delete", "Global") wait(1) click($element offset(<tagname="span">, 6), "Left Click", "No") wait for browser event("Everything Loaded", "") wait(3) }This was scrapping pages one after the other. Skips one now ? Do you see something weird ? Thanks Quote Link to post Share on other sites
AutomationNinja 194 Posted January 24, 2013 Report Share Posted January 24, 2013 Hmmm... Looked ok to me. Not sure why it would be doing that. Maybe increase the wait time before clicking on the next page? Quote Link to post Share on other sites
blumi40 222 Posted January 24, 2013 Report Share Posted January 24, 2013 click($element offset(<tagname="span">, 6), "Left Click", "No") here is the problem i thing offset is not a good choice Quote Link to post Share on other sites
Twitter Dominator 125 Posted January 24, 2013 Report Share Posted January 24, 2013 seen that on a few sites you might want to try to add between these lines click($element offset(<tagname="span">, 6), "Left Click", "No") wait(some element of the page that is visible) $exists wait for browser event("Everything Loaded", "") wait(3) Quote Link to post Share on other sites
webpro 31 Posted January 25, 2013 Author Report Share Posted January 25, 2013 I see, thanks guys EDITED: Just tried some of the tips. Still doing it.Man this is odd ? Maybe this thread should be placed into the bug section lol ! Quote Link to post Share on other sites
Twitter Dominator 125 Posted January 25, 2013 Report Share Posted January 25, 2013 im sure if we knew which site and page it was actually trying to scrape we could help more Quote Link to post Share on other sites
webpro 31 Posted January 26, 2013 Author Report Share Posted January 26, 2013 We ll can't say that in here too much lurkers hahahahahahaha I will pm you Right now it scrapes page one,2 then jumps to 5 and then 7,9,11,13,15,17 etc... (+2 increment go figure)3 secs time inserted and it still jumping pages Quote Link to post Share on other sites
gabel 51 Posted January 26, 2013 Report Share Posted January 26, 2013 pm too and i`ll take a look Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.