Find Fuzzy Duplicates in CSV Files Online
Find near-duplicate rows in CSV files using Levenshtein edit distance or Jaro-Winkler similarity — all in your browser. Set your own threshold and download the matched pairs as CSV — no upload required.
About this tool
Find and remove near-duplicate rows in a CSV file using string similarity matching — catching typos, abbreviations, and inconsistent formatting that exact deduplication misses. Set a similarity threshold, choose the column to match on, and download a deduplicated file with flagged pairs. Ideal for cleaning customer names, addresses, and product descriptions. All processing runs locally in your browser.
Frequently Asked Questions
How is fuzzy deduplication different from exact deduplication for CSV files?
Exact deduplication removes rows where all columns match perfectly. Fuzzy deduplication finds rows that are similar but not identical — for example "John Smith" and "Jon Smith" or "123 Main St" and "123 Main Street". It uses string similarity to identify near-matches that represent the same real-world entity.
What similarity threshold should I use when fuzzy-deduplicating a CSV file?
Start with 0.85 (85% similarity). A lower threshold catches more duplicates but risks merging distinct records. A higher threshold is more conservative and safer when small differences are meaningful. Review the flagged pairs at your chosen threshold before committing.
Can I fuzzy-deduplicate on multiple columns in a CSV file?
Choose the single column that best identifies the entity — typically a name, address, or description. For multi-column matching such as first name + last name together, use the Concatenate Columns tool to combine them into one column before running fuzzy deduplication.
Is my data private?
Yes — completely. Your file is never uploaded to any server. Everything runs locally in your browser using WebAssembly — processing happens entirely inside your tab. Once you close the tab, nothing is retained.
What is the maximum file size?
The free limit is 50 MB. For larger files, performance depends on your device's available memory — most modern machines handle 500 MB to 1 GB comfortably.
Related Tools
Group Concatenate CSV Files Online
Concatenate text values within each group in CSV files directly in your browser. Group rows by a column and join the values of another column into a single delimited string — no upload required.
Truncate Dates in CSV Files Online
Truncate date and timestamp columns in CSV files to a chosen precision — year, quarter, month, week, day, hour, or minute — directly in your browser. Rounds timestamps down to the start of each period. No upload required.
Coalesce Columns in CSV Files Online
Fill null values in CSV files from other columns — return the first non-null value across up to 8 columns in priority order. Add the result as a new column. Runs entirely in your browser.
Add UUID Column to CSV Files Online
Add a UUID column to CSV files directly in your browser. Generate random UUIDv4 or time-ordered UUIDv7 identifiers for every row. Choose the column name and position — no upload required.
Pad Column in CSV Files Online
Left-pad or right-pad a column in CSV files to a fixed width directly in your browser. Zero-pad numeric codes, pad product IDs to a fixed length, or right-pad text fields — no upload required.