musician87 2 Posted May 5, 2015 Report Share Posted May 5, 2015 I've scraped few things, but it's full of duplicates. How I can remove them? I've read a bunch of solutions here on forum but nothing helped me. Someone can help me? my list is called $scraped just for reference... Quote Link to post Share on other sites
itexspert 47 Posted May 5, 2015 Report Share Posted May 5, 2015 Put them in a list Ubot will automatically remove Duplicates! "add list to list" is the command you need Quote Link to post Share on other sites
HelloInsomnia 1103 Posted May 6, 2015 Report Share Posted May 6, 2015 Can you post the Ubot code and site you're scraping? You may have to use $trim or something if the duplicate items seem to be getting added when your list is using remove duplicates like itexspert said. Quote Link to post Share on other sites
musician87 2 Posted May 6, 2015 Author Report Share Posted May 6, 2015 Put them in a list Ubot will automatically remove Duplicates! "add list to list" is the command you need Seems not working, since I select it but it's full of duplicates. Can you post the Ubot code and site you're scraping? You may have to use $trim or something if the duplicate items seem to be getting added when your list is using remove duplicates like itexspert said. I've sent you a PM with the code, I got few project stolen and then sold here on forum by share it. Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.