Remove Duplicate Lines
Remove duplicate lines from a list and keep only the first occurrence of each one, with options for case sensitivity, sorting, and blank lines.
How to use
- Paste your list into the box.
- Set whether case matters and whether the result is sorted.
- Copy the deduplicated list.
Removing duplicate lines is the fastest way to clean a list that has been pasted more than once, appended to from several sources, or collected from a spreadsheet with repeated entries.
Output
Paste or type something above.
Questions about remove duplicate lines
- Which copy is kept?
- The first occurrence in the input, so the original order is preserved unless you ask for sorting.
- Does it compare case?
- By default it does not, because Ada and ada are usually the same entry in a list. Turn the option on to treat them as different.
- Does it remove blank lines?
- Only if you ask, since a blank line can be a deliberate separator.
Related tools
- Sort Lines Sort a list of lines alphabetically, by length, or numerically, with options for case sens...
- Text Cleaner Strip hidden and invisible characters, normalise line endings and tabs, collapse blank lin...
- Remove Extra Spaces Collapse multiple spaces and tabs into a single space and trim the ends of every line, whi...