removing duplicates in txt file

[rocket976 62]

I know this has been mentioned before but the only example code I can find is for 3.5. so Im kinda lost here

 

I have this list of projects for ex

 

test

test 1

test 1

test

test 2

test 2

test 2

test

test 2

test 2

test

test 2

test 2

test 3

test 3

 

note all the duplicates it should only show

 

test

test 1

test 2

test 3

 

So Im thinking I need to check this after it creates the list, but im pretty lost.. want to do this right from the get go..

 

thanks in advance

[Enigma 78]

I know this has been mentioned before but the only example code I can find is for 3.5. so Im kinda lost here

 

I have this list of projects for ex

 

test

test 1

test 1

test

test 2

test 2

test 2

test

test 2

test 2

test

test 2

test 2

test 3

test 3

 

note all the duplicates it should only show

 

test

test 1

test 2

test 3

 

So Im thinking I need to check this after it creates the list, but im pretty lost.. want to do this right from the get go..

 

thanks in advance

 

Simply create a loop => $list total => %duplicate list

Inside the loop $add to list => $next list item from %duplicate list

remove duplicates => yes.

Then save the new list.

Done.

[rocket976 62]

I knew it was something like that. MINT that does it. Thanks Engima better than a support line , not even 5 min response !

[LoWrIdErTJ - BotGuru 904]

nah...

 

add list to list, list from text, then drop the list in there, with new line as the delimiter.

done all in 1 node.

[Josh 37]

I'm trying to remove duplicate urls from a list, but I'm not following at all. Can this be clarified for us idiots?

[a2mateit 395]

I'm trying to remove duplicate urls from a list, but I'm not following at all. Can this be clarified for us idiots?

Add the list you are trying to remove duplicates to another list with allow duplicates setting turned to no. You can find it under advanced settings.

 

For example:

add list to list(%duplicate free list, %list you want to remove duplicates from, "Delete", "Global")

 

Justin

[nimbystripes 0]

Will this program works on MS Word or other text editor software?

[jomark3 25]

I'm trying to remove duplicate urls from a list, but I'm not following at all. Can this be clarified for us idiots?

 

Hey Josh,

 

This little 1 node bot does the trick.

remove dupes from list.ubot

[Wall-E 0]

Hey Josh,

 

This little 1 node bot does the trick.

thanks

[The Guru 0]

Awesome guys thanks! Thanks jomark, as well!!