linux/uniq

Remove Duplicates

Report or omit repeated lines

text
duplicates
filtering

Command

uniq

Explanation

uniq filters out repeated lines in a file, often used after sort.

Examples

Remove duplicate lines

sort file.txt | uniq

Count occurrences

uniq -c file.txt

Show only duplicate lines

uniq -d file.txt