Jump to content
UBot Underground

Hold Duplicate Domain Xxx Items, Does Anyone Know How To?


Recommended Posts

Hello,

 

E. G:

 

I have list:

http://abc.com/sample-permalink1/
http://abc.com/sample-permalink2/
http://abc.com/sample-permalink3/
http://abc.com/sample-permalink4/
http://abc.com/sample-permalink5/
http://abc.com/sample-permalink6/
http://abc.com/sample-permalink7/
http://abc.com/sample-permalink8/
http://abc.com/sample-permalink9/

then I want to hold 5 lines from the list and remove the rest so the final list would be:

http://abc.com/sample-permalink1/
http://abc.com/sample-permalink2/
http://abc.com/sample-permalink3/
http://abc.com/sample-permalink4/
http://abc.com/sample-permalink5/

Thanks so much for your help

Link to post
Share on other sites

How if my list like this:

http://abc.com/sample-permalink1/
http://abc.com/sample-permalink2/
http://abc.com/sample-permalink3/
http://abc.com/sample-permalink4/
http://abc.com/sample-permalink5/
http://abc.com/sample-permalink6/
http://abc.com/sample-permalink7/
http://abc.com/sample-permalink8/
http://abc.com/sample-permalink9/
http://abc.net/sample-permalink1/
http://abc.net/sample-permalink2/
http://abc.net/sample-permalink3/
http://abc.net/sample-permalink4/
http://abc.net/sample-permalink5/
http://abc.net/sample-permalink6/
http://abc.net/sample-permalink7/
http://abc.net/sample-permalink8/
http://abc.net/sample-permalink9/
http://abc.org/sample-permalink1/
http://abc.org/sample-permalink2/
http://abc.org/sample-permalink3/
http://abc.org/sample-permalink4/
http://abc.org/sample-permalink5/
http://abc.org/sample-permalink6/
http://abc.org/sample-permalink7/
http://abc.org/sample-permalink8/
http://abc.org/sample-permalink9/
http://abc.info/sample-permalink1/
http://abc.info/sample-permalink2/
http://abc.info/sample-permalink3/
http://abc.info/sample-permalink4/
http://abc.info/sample-permalink5/
http://abc.info/sample-permalink6/
http://abc.info/sample-permalink7/
http://abc.info/sample-permalink8/
http://abc.info/sample-permalink9/

which is I want hold 5 urls from each domain?

Link to post
Share on other sites

clear list(%Output)
add list to list(%Output,$list from text("http://abc.com/sample-permalink1/
http://abc.com/sample-permalink2/
http://abc.com/sample-permalink3/
http://abc.com/sample-permalink4/
http://abc.com/sample-permalink5/
http://abc.com/sample-permalink6/
http://abc.com/sample-permalink7/
http://abc.com/sample-permalink8/
http://abc.com/sample-permalink9/
http://abc.net/sample-permalink1/
http://abc.net/sample-permalink2/
http://abc.net/sample-permalink3/
http://abc.net/sample-permalink4/
http://abc.net/sample-permalink5/
http://abc.net/sample-permalink6/
http://abc.net/sample-permalink7/
http://abc.net/sample-permalink8/
http://abc.net/sample-permalink9/
http://abc.org/sample-permalink1/
http://abc.org/sample-permalink2/
http://abc.org/sample-permalink3/
http://abc.org/sample-permalink4/
http://abc.org/sample-permalink5/
http://abc.org/sample-permalink6/
http://abc.org/sample-permalink7/
http://abc.org/sample-permalink8/
http://abc.org/sample-permalink9/
http://abc.info/sample-permalink1/
http://abc.info/sample-permalink2/
http://abc.info/sample-permalink3/
http://abc.info/sample-permalink4/
http://abc.info/sample-permalink5/
http://abc.info/sample-permalink6/
http://abc.info/sample-permalink7/
http://abc.info/sample-permalink8/
http://abc.info/sample-permalink9/",$new line),"Delete","Global")
loop while($comparison($list total(%Output),">",5)) {
remove from list(%Output,$subtract($list total(%Output),1))
}

  • Like 1
Link to post
Share on other sites

hi Zap thanks for reply and your sample code but result like this:

http://abc.com/sample-permalink1/
http://abc.com/sample-permalink2/
http://abc.com/sample-permalink3/
http://abc.com/sample-permalink4/
http://abc.com/sample-permalink5/

any suggestion to make code like this:

 

https://www.youtube.com/watch?v=212I9IWK9L4

 

 

 

thanks

Link to post
Share on other sites

Im reading this on my phone so i cant code it.

But this seems pretty straight foward.

1-read thru the list and regx up to the first slash (deleting all dups)that should give u 1 of every domain

2-read thru the small list and compare against evry line in the big lis. If the line in the big list contains the check item add item to list (deleting any dupes) until that list equals 5 when u hit 5 save that list somewhere. Clear the list and repeat with next item in small list until the small list is exhausted

Link to post
Share on other sites

Im reading this on my phone so i cant code it.

But this seems pretty straight foward.

1-read thru the list and regx up to the first slash (deleting all dups)that should give u 1 of every domain

2-read thru the small list and compare against evry line in the big lis. If the line in the big list contains the check item add item to list (deleting any dupes) until that list equals 5 when u hit 5 save that list somewhere. Clear the list and repeat with next item in small list until the small list is exhausted

 

I got the idea but I still not fixed it

Input List()
loop($table total rows(&Original URLs)) {
    set(#hostname,$find regular expression($table cell(&Original URLs,0,0),"(http|https)\\:\\/\\/[a-z0-9\\.]+[\\.a-z]+\\/?"),"Global")
    add list to list(%hostname,$list from text(#hostname,$new line),"Delete","Global")
    plugin command("TableCommands.dll", "delete from table", &Original URLs, "Row", 0)
}
Input Domain To hold()
loop($table total rows(&Original URLs)) {
    wait(0.05)
    loop($table total rows(&Domain to Hold)) {
        if($contains($table cell(&Original URLs,0,0),$table cell(&Domain to Hold,0,0))) {
            then {
                wait(0.05)
                add item to list(%Final,$table cell(&Original URLs,0,0),"Don\'t Delete","Global")
            }
        }
        plugin command("TableCommands.dll", "delete from table", &Domain to Hold, "Row", 0)
    }
    wait(0.05)
    plugin command("TableCommands.dll", "delete from table", &Original URLs, "Row", 0)
}
Refill List to Hold()
stop script
define Input Domain To hold {
    set list position(%hostname,0)
    clear table(&Domain to Hold)
    add list to table as column(&Domain to Hold,0,0,%hostname)
}
define Refill List to Hold {
    set(#ListPath,"http://abc.com/sample-permalink1/
http://abc.com/sample-permalink2/
http://abc.com/sample-permalink3/
http://abc.com/sample-permalink4/
http://abc.com/sample-permalink5/
http://abc.com/sample-permalink6/
http://abc.com/sample-permalink7/
http://abc.com/sample-permalink8/
http://abc.com/sample-permalink9/
http://abc.net/sample-permalink1/
http://abc.net/sample-permalink2/
http://abc.net/sample-permalink3/
http://abc.net/sample-permalink4/
http://abc.net/sample-permalink5/
http://abc.net/sample-permalink6/
http://abc.net/sample-permalink7/
http://abc.net/sample-permalink8/
http://abc.net/sample-permalink9/
http://abc.org/sample-permalink1/
http://abc.org/sample-permalink2/
http://abc.org/sample-permalink3/
http://abc.org/sample-permalink4/
http://abc.org/sample-permalink5/
http://abc.org/sample-permalink6/
http://abc.org/sample-permalink7/
http://abc.org/sample-permalink8/
http://abc.org/sample-permalink9/
http://abc.info/sample-permalink1/
http://abc.info/sample-permalink2/
http://abc.info/sample-permalink3/
http://abc.info/sample-permalink4/
http://abc.info/sample-permalink5/
http://abc.info/sample-permalink6/
http://abc.info/sample-permalink7/
http://abc.info/sample-permalink8/
http://abc.info/sample-permalink9/","Global")
    clear table(&Original URLs)
    create table from text(&Original URLs,#ListPath)
}
define Input List {
    clear all data
    set(#ListPath,"http://abc.com/sample-permalink1/
http://abc.com/sample-permalink2/
http://abc.com/sample-permalink3/
http://abc.com/sample-permalink4/
http://abc.com/sample-permalink5/
http://abc.com/sample-permalink6/
http://abc.com/sample-permalink7/
http://abc.com/sample-permalink8/
http://abc.com/sample-permalink9/
http://abc.net/sample-permalink1/
http://abc.net/sample-permalink2/
http://abc.net/sample-permalink3/
http://abc.net/sample-permalink4/
http://abc.net/sample-permalink5/
http://abc.net/sample-permalink6/
http://abc.net/sample-permalink7/
http://abc.net/sample-permalink8/
http://abc.net/sample-permalink9/
http://abc.org/sample-permalink1/
http://abc.org/sample-permalink2/
http://abc.org/sample-permalink3/
http://abc.org/sample-permalink4/
http://abc.org/sample-permalink5/
http://abc.org/sample-permalink6/
http://abc.org/sample-permalink7/
http://abc.org/sample-permalink8/
http://abc.org/sample-permalink9/
http://abc.info/sample-permalink1/
http://abc.info/sample-permalink2/
http://abc.info/sample-permalink3/
http://abc.info/sample-permalink4/
http://abc.info/sample-permalink5/
http://abc.info/sample-permalink6/
http://abc.info/sample-permalink7/
http://abc.info/sample-permalink8/
http://abc.info/sample-permalink9/","Global")
    clear table(&Original URLs)
    create table from text(&Original URLs,#ListPath)
    clear list(%hostname)
    clear list(%Final)
}
Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
×
×
  • Create New...