Scraping Twitch

[Asentrix 17]

Need help scraping twitch usernames from game directories.

There's no exact element to scrape twitch usernames within game directories as far as I can see

The only way is to scrape the channel links "/example" and add them to a list

 

Only problem is , when scraping the href using a wildcard , you pick up all the generic / crappy links with it.

I was hoping some regex expert could help me filter the href  / links on the page?

 

-

 

The page

 

http://www.twitch.tv/directory

 

Any game category works

[HelloInsomnia 1103]

You can use this:

add list to list(%usernames, $scrape attribute(<href=w"/*/profile">, "href"), "Delete", "Global")

Then just use the $replace function to get rid of the bits you don't need like / and /profile

[Asentrix 17]

That doesn't seem to work :l

Also with the replace function , I don't think it's able to remove wildcards is it?

 

Eg. /profile/random-string

 

Thanks for the help!

[HelloInsomnia 1103]

If you want to regex you can do this:

add list to list(%usernames, $find regular expression($document text, "(?<=\\/).*?(?=\\/profile)"), "Delete", "Global")