Text Tools
Remove Duplicate Lines
Paste a list to strip out repeated lines. The original order is kept — the first occurrence of each line stays where it was — because sorting a list as a side effect of deduplicating it is rarely what anyone wants.
When off, Apple and apple count as the same line
Note
Everything happens in your browser. Nothing you paste is uploaded or stored.
How to use this tool
- Paste your list, one item per line.
- Choose whether to keep the first copy of each repeated line or remove every copy.
- Choose whether capital letters matter.
- The count of removed lines appears above the result.
Worked examples
Cleaning an email list
- Paste addresses one per line
- Leave 'Ignore case' selected, since email addresses are not case sensitive in practice
Each address appears once, in the order it first appeared.
Notes and limitations
- Order is preserved. The first occurrence of each line keeps its position, and later copies are removed.
- Leading and trailing spaces are ignored when comparing, so a line with a stray space is still recognised as a duplicate.
- 'Remove every repeated line' drops all copies of anything that appears more than once, leaving only lines that were unique to begin with. It is the right choice for finding the odd one out, not for deduplicating.
- Everything runs in your browser. Your text is never uploaded to a server, which matters when what you are working on is a draft, a client list or anything else you would rather not send anywhere.
Frequently asked questions
Does this sort my list?
No. The order is preserved deliberately. Use the Text Sorter if you want it sorted as well.
Are Apple and apple treated as duplicates?
By default yes, since that is usually what people want. Switch to case sensitive if the difference matters.
What does 'remove every repeated line' do?
It removes all copies of any line that appears more than once, rather than keeping one. The result is the lines that were already unique — useful for spotting entries that appear in one list but not another.
Related tools
- Text SorterSort lines alphabetically, numerically, by length or at random.
- Remove Extra SpacesCollapse repeated spaces and tidy up messy whitespace.
- Word CounterCount words and characters with reading time, as you type.
- Character CounterCount characters against common field and post limits.
- Sentence CounterCount sentences and see the average words per sentence.
- Paragraph CounterCount paragraphs and lines, with average paragraph length.