Remove duplicate rows from a CSV export
Exports that overlap in their date ranges, or that were pasted together from two downloads, hold the same transaction twice. Importing them counts that money twice. Choose the file below: the page works in your browser, shows the first 20 cleaned rows and lists every line it left out, with the reason.
Clean your CSV export
The cleaner detects the delimiter (comma, semicolon or tab), looks for a header row with a date column and an amount column, and writes eight fixed columns, comma-delimited: date, description, amount, currency, fee, net, reference and source. It recognises common header names in English, Spanish, German and French, such as Date, Fecha, Buchungstag, Amount, Importe, Betrag and Montant.
Your file is read in your browser and is never uploaded, stored or logged. It is held in the memory of this tab only, and closing or reloading the page discards it. Operator: Augeo. See the privacy notice.
Exports do not share one layout, and this page makes no promise about yours: the free preview shows what it does to your file.
The cleaning logic is checked by an automated test script that runs the engine file of this site over six synthetic sample files and a set of checks of the parsing rules; it ran in a sandbox before this site was published and finished with no failed check. The script does not open this page in a browser, does not test the licence key step, and nothing was tested against a real export from any provider. Use the free preview to check your own file.
Report
Warnings
Lines not parsed
Lines dropped
Preview of the cleaned rows
| line | date | description | amount | currency | fee | net | reference | source |
|---|
Download the full cleaned file
- Price: 6 USD, paid once on Gumroad. No subscription. You receive a licence key.
- What the key unlocks: the download of every cleaned row of the file you chose, as one CSV named after your file with -cleaned.csv at the end, instead of the first 20 rows on screen. The report and the way files are read stay the same.
- The key is for one buyer. Runs are not counted and no number of runs is promised. The key is kept in the memory of this page only, so you enter it again after closing or reloading the page.
- Refunds are requested through your Gumroad receipt and follow Gumroad's refund policy.
- Try the free preview first. If the preview cannot read your file, the full download cannot either.
Get a licence key on Gumroad for 6 USD
What counts as a duplicate, and what happens to it
- Only exact copies count. Two rows are duplicates when every cell of one equals the same cell of the other, after spaces at the ends of each cell are removed. Rows that differ in any column of your file, such as a running balance or a reference, are both kept.
- The first copy stays. Later copies are dropped wherever they are in the file; they do not need to be next to each other.
- Every dropped row is listed under "Lines dropped" with its own line number, the line number of the copy that was kept and its text.
- Rows that could not be read are not compared. They are listed under "Lines not parsed" instead.
Two identical rows can be two real payments: the same amount to the same payee on the same day, in an export with no reference or balance column. This page has no switch to keep such rows. Read the list of dropped lines, and if one of them is a real second payment, add it back to the cleaned file by hand.
Near-duplicates are not detected: the same payment written with a different description or date in two files stays twice.
The output is always the same eight columns (date, description, amount, currency, fee, net, reference and source), comma-delimited. Columns of your file that are not among them are not carried over, so this is a cleaner for files of transactions and not a general CSV editor.
By hand: in a spreadsheet, sort by every column and compare each row with the one above it, or use the remove-duplicates command with all columns selected and note how many rows it says it removed.
Notices
- Privacy: files are read in your browser and never uploaded, stored or logged. Operator: Augeo.
- Independent tool, not affiliated with or endorsed by Etsy, PayPal, QuickBooks or any bank.
- Check the output before you use it. This is not accounting, tax or financial advice.
- Price of the full download: 6 USD one-time. The key is for one buyer. Refunds are requested through the Gumroad receipt.
- Only upload data you have the right to process. Choosing a file here does not send it anywhere, but you remain responsible for the data in it.