Remove Duplicate Lines
Pasted a list and half the entries are in there twice? Drop your text in and the penguin tosses every repeat line — keeping the first occurrence and the original order.
How to use
- Paste your text. One item per line — names, emails, URLs, SKUs, whatever needs cleaning.
- Set your options. Case-sensitive matching treats “Apple” and “apple” as different; drop-empty-lines tosses the blanks.
- Click Remove duplicates. Repeats vanish; every first occurrence stays exactly where it was.
- Copy the clean list. One tap puts the deduplicated result on your clipboard.
Deduping without wrecking your list
Duplicate lines creep in from merged spreadsheets, scraped lists, and the classic move of pasting the same export twice. Removing them by hand works up to about fifty lines; after that you need a tool and a decision: does order matter? This one keeps the first occurrence of each line and drops later repeats, so a list sorted by importance stays sorted.
Two gotchas. Near-duplicates are not duplicates — "Smith, John" and "John Smith" are different lines to any tool, as are lines that differ only by a trailing space. Clean those first if your data came from several sources. And if you're deduping email addresses for a mailing list, work on a copy: once duplicates are gone they're gone, and the original file is your only evidence of who was on the list twice — which, occasionally, is a thing you need to know.
Frequently asked questions
How do I remove duplicate lines from text online?
Paste your text into the box above, choose your options, and click Remove duplicates. The first occurrence of every line is kept and repeats are deleted, with the original order preserved. Nothing is uploaded — it all happens in your browser.
Does it keep the first or the last occurrence?
The first. If “apple” appears on lines 2, 5, and 9, line 2 stays and the later ones are removed. Everything else keeps its original position.
What does case-sensitive matching mean here?
With case-sensitive on, “Apple” and “apple” count as different lines and both survive. Turn it off and they're treated as the same line, so only the first one stays. Pick whichever matches how you'll use the list.
Can I remove duplicates from an Excel column?
Yes — copy the column in Excel or Google Sheets, paste it here (it arrives as one item per line), dedupe, then copy the result and paste it back. Works for CSV columns too.
Is my pasted text sent to a server?
No. Like every tool on this site, deduping runs entirely in your browser. Your list never leaves the page.
Related tools
Keep the momentum going.