looping a scrape and nothing to scrape

[stanf 43]

I was scraping a site , every thing was going fine when the site had a hiccup and left me with nothing to scrape. how is this handled by you pros?

I know now that i have to put in a a test to make sure that the target of the scrape is actually there?

But if it isn't how do I make the loop start over?

or

do I put in a javascript to reload the page and hope that it reloads the proper page?

[k1lv9h 76]

Hi,

 

Sample code:

set(#checkedpagedata, "false", "Global")
set(#checkedpagedatacount, 0, "Global")
loop while($comparison(#checkedpagedata, "=", "false")) {
if($exists(<innertext="5 star">)) {
 then {
	 set(#checkedpagedata, "true", "Global")
 }
 else {
	 if($comparison(#checkedpagedatacount, ">=", 9)) {
		 then {
			 run javascript("window.location.reload()")
			 wait for element(<innertext="5 star">, 30, "Appear")
			 set(#checkedpagedatacount, 0, "Global")
		 }
		 else {
		 }
	 }
	 wait(1)
	 increment(#checkedpagedatacount)
 }
}
}

 

Change these lines to a element on the webpage you are about to scrape. It will not get out of the loop until the element appears on the webpage.

if($exists(<innertext="5 star">)) {

wait for element(<innertext="5 star">, 30, "Appear")

 

sample-page-check-reload-001.ubot

 

Kevin

[stanf 43]

thanks that what i thought check, check for a common element and if it is not there reload the page,

 

thanx again