{"author_url":"https://blog.hatena.ne.jp/BioErrorLog/","title":"Remove Duplicate Lines with One Command","provider_name":"Hatena Blog","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/B/BioErrorLog/20250419/20250419092202.png","provider_url":"https://hatena.blog","description":"You can easily do this with awk: awk '!seen[$0]++' Introduction Remove Duplicate Lines with One Command Command Breakdown Example Conclusion Reference Introduction This is a quick note on how to remove duplicate lines and show each line only once using a command. Note: This article was translated fr\u2026","categories":["Linux"],"html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fen.bioerrorlog.work%2Fentry%2Funique-lines-in-shell\" title=\"Remove Duplicate Lines with One Command - BioErrorLog Tech Blog\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","blog_url":"https://en.bioerrorlog.work/","published":"2025-04-19 09:22:30","type":"rich","url":"https://en.bioerrorlog.work/entry/unique-lines-in-shell","blog_title":"BioErrorLog Tech Blog","author_name":"BioErrorLog","height":"190","width":"100%","version":"1.0"}