Duplicate Text / Line Remover
Strip repeated lines or paragraphs out of a list, keeping the order they arrived in or sorting what is left. It runs in your browser, so nothing you paste is sent anywhere. It is free, needs no account, and adds no watermark to your result.
Loading text tools…
Working with other formats? Open your file workspace →
What people use it for.
What happens to your file.
The work happens in your browser with a local pass: what you paste is never uploaded or stored. Each line is compared against the ones already kept, and a repeat is dropped while the first occurrence stays. Preserving order keeps that first occurrence exactly where it was, which matters when the sequence means something; sorting instead gives you the unique values in alphabetical order. Case sensitivity is yours to choose, so Apple and apple can count as the same entry or as two. Lines that differ only in spaces, or in how an accent is encoded, count as the same line, and blank lines between groups are kept rather than treated as duplicates; untick Ignore extra spaces for an exact comparison, or tick Remove empty lines to drop them.
Where it stops: A duplicate here means the same words: extra spaces and differently encoded accents are ignored, but a different kind of quotation mark, or one entry written slightly differently, still reads as distinct, so run Text Cleaner first if the list came from somewhere messy. Paragraph mode needs blank lines between paragraphs to know where they start and end, and very large lists will be slower because every line is compared against those kept before it.
Everything you need, without a paywall.
Common questions.
Is my text uploaded anywhere?
No. The de-duplication runs in your browser, so what you paste never leaves your computer and is not stored.
Which copy is kept?
The first one. Later repeats are dropped, so preserving order leaves the first occurrence exactly where it was.
Why were two lines that look identical both kept?
Something invisible differs that spacing does not explain, usually a different quotation mark or a hidden character. Run Text Cleaner over the list first, then de-duplicate.
Are blank lines removed?
No. Blank lines separating groups are kept, with any run of them shortened to one. Tick Remove empty lines to drop them all.
Can I ignore capitalisation?
Yes. Turn off case sensitivity and Apple and apple are treated as the same entry.
You might also need.
Clean messy text by removing duplicate spaces, empty lines, HTML, invisible characters and unwanted formatting.
Convert text between uppercase, lowercase, title case, sentence case, camelCase, PascalCase, snake_case and kebab-case.
Compare two pieces of text and instantly highlight added, removed and changed content side by side.
Count and rank repeated words with stop-word filtering, minimum-length control and frequency percentages.