Making blacklist

[iglow 8]

Ok i have a file with a bunch of urls that i navigate in a loop.

ANd lets say i want to make a blacklist of domains [but rmemeber that urls on top may have exact pages on domain, so 1 domain can have 50 urls in 1st file] so then it wont navigate to them.

I was trying to think of some idea but i really cant. Anybody?

It could even be maybe clearing out the list on the start before navigating anywhere but i dont know how to do that on .txt files.

[Aaron Nimocks 19]

I cant follow exactly what you want to do.

 

But it sounds like you want to separate stuff and to make sure it is saved. The way to do that is to create separate lists as you are going through and then save them.

[iglow 8]

Ok ill put it more clearly

Lets say i habve FileA and FileB

I want bot to check every adress in fileA and if its in fileB then i want it to be deleted from the list and then list saved o nthe end. Any idea?

[alcr 135]

Take a look at this example

[iglow 8]

alcr - i dodnt see any file

[alcr 135]

Hehe wops, here it is.

list cleaner.ubot

[iglow 8]

Okay very nice and thanx for it, that solves my problem but partially So now we have this claeaner which cleans on 1:1

if http://google.com found then deletes it.

But lets say 1st file [the one to be clened] has:

http://google.com/page1.html

http://google.com/page2.html

http://google.com/page3.html

 

and file2 [teh blacklist] has just the main domain:

http://google.com

 

is there a way to modify the list cleaner in that case ?

[alcr 135]

Hmm, well this have to be done with some javascript-magic. And I have pretty much no knowledge about that sorry.