How Use $not($contains in Scape Attributes

[alexb 2]

I am trying to scrape profiles, but my scrape is getting "contaminated" with another profile:

 

Example:

 

/profile/user210/     (desired to scrape)

/profile/user210/Reviews/     (I want to avoid these)

 

The following code doesn't help me avoid those with Reviews.   What might be be doing wrong?       Thank you.

 

 

   if($not($contains($url, "Reviews"))) {
        then {
            add list to list(%url, $scrape attribute(<href=w"/profile/*/">, "fullhref"), "Delete", "Global")

[kev123 132]

1.just to be clear are you trying to scrape the profiles on

 

/profile/user210/     (this page only)

/profile/user210/Reviews/    

 

or

 

2.are you trying to scrape profiles of a page which has a combination of the below.

 

/profile/user210/     (and you only want this)

/profile/user210/Reviews/     (I want to avoid these)

[UBotDev 276]

You can try with "$element offset" function and set offset to 0, which should retrieve the top most match.

 

The safer way would be to write a better attribute selector or even use REGEX.

[alexb 2]

I'll try the element offset to see if this works.

 

Kev, I want to avoid anything with Reviews in the URL.

 

Thanks!

[alexb 2]

Yes, Element Offset worked like a charm!   Much appreciated!