Remove duplicate lines
Remove repeated lines while keeping the first occurrence and your list’s order.
Processed on this device. The content is not uploaded to a server.
Up to 100,000 characters and 10,000 lines. Automatic preview; your data is not saved.
Text preview
How to use this tool
- Paste the lines you want to deduplicate.
- Choose whether to ignore case or leading and trailing spaces when comparing.
- Check how many lines were removed and download the list.
What you should know
Up to 100,000 characters and 10,000 lines. Keeps the original text of the first occurrence. Compares Unicode NFC; ignoring spaces only affects comparison. Normalizes line breaks to LF.
Does the content of the retained lines change?
No. The first line is kept as it was, including its spaces. Only line breaks are normalized; the options affect duplicate detection.