Text tool / 100% free

Duplicate Text / Line Remover

Strip repeated lines or paragraphs out of a list, keeping the order they arrived in or sorting what is left. It runs in your browser, so nothing you paste is sent anywhere. It is free, needs no account, and adds no watermark to your result.

Built for: remove duplicate lines

Loading text tools…

When you need this

What people use it for.

Cleaning a mailing list assembled from several exports
De-duplicating a list of URLs, SKUs or reference numbers
Tidying notes where the same line was pasted twice
Preparing a keyword list before loading it into something else
How it works

What happens to your file.

The work happens in your browser with a local pass: what you paste is never uploaded or stored. Each line is compared against the ones already kept, and a repeat is dropped while the first occurrence stays. Preserving order keeps that first occurrence exactly where it was, which matters when the sequence means something; sorting instead gives you the unique values in alphabetical order. Case sensitivity is yours to choose, so Apple and apple can count as the same entry or as two. Lines that differ only in spaces, or in how an accent is encoded, count as the same line, and blank lines between groups are kept rather than treated as duplicates; untick Ignore extra spaces for an exact comparison, or tick Remove empty lines to drop them.

Where it stops: A duplicate here means the same words: extra spaces and differently encoded accents are ignored, but a different kind of quotation mark, or one entry written slightly differently, still reads as distinct, so run Text Cleaner first if the list came from somewhere messy. Paragraph mode needs blank lines between paragraphs to know where they start and end, and very large lists will be slower because every line is compared against those kept before it.

What this tool includes

Everything you need, without a paywall.

Free Pro export naming included
Duplicate lines
Duplicate paragraphs
Case sensitivity
Sort
Preserve order
Questions

Common questions.

Is my text uploaded anywhere?

No. The de-duplication runs in your browser, so what you paste never leaves your computer and is not stored.

Which copy is kept?

The first one. Later repeats are dropped, so preserving order leaves the first occurrence exactly where it was.

Why were two lines that look identical both kept?

Something invisible differs that spacing does not explain, usually a different quotation mark or a hidden character. Run Text Cleaner over the list first, then de-duplicate.

Are blank lines removed?

No. Blank lines separating groups are kept, with any run of them shortened to one. Tick Remove empty lines to drop them all.

Can I ignore capitalisation?

Yes. Turn off case sensitivity and Apple and apple are treated as the same entry.

Related free tools

You might also need.