Sample Header Ad - 728x90

remove duplicate lines across multiple txt files

-1 votes
1 answer
1913 views
I have 12 text files all in one folder, each with about 5 million lines, each file has no duplicate line on its own but there are duplicated across multiple files, I want to remove the duplicate lines in each file but still save them separately, I have tried many Linux sort command and it keep merging the file together, I have Windows, Linus, and Mac, Is there any code or application that can do this?
Asked by Surprise Awofemi (41 rep)
Jan 14, 2022, 05:52 PM
Last activity: Jan 15, 2022, 06:24 AM