Table of Contents
DEDUPLICATE ROWS
Category: Transform / Filters
Description
This action removes all duplicate rows in the entire table. Deduplication can be performed based on all columns, or only on specific columns.
Use cases
Use Deduplicate rows to clean datasets of records that may have been duplicated in the source dataset, or during previous actions.
Action settings
| Setting | Description |
|---|---|
| Apply to | Select whether to base deduplication on all columns in the dataset, or only selected columns. Options: All columns or Selected columns (and select the columns to use from the list). |
Remarks
When deduplicating based on specific columns:
- The uniqueness of values in non-selected columns will be ignored.
- Duplicate rows are removed from the dataset from the bottom, up.
Examples
Example: Find and remove duplicate rows.
Source table: The longest rivers in the world
| River | Length (km) | Continent |
|---|---|---|
| Nile | 6650 | Africa |
| Amazon | 6400 | South America |
| Nile | 6650 | Africa |
Action parameters:
Apply to "All columns"
Result table:
| River | Length (km) | Continent |
|---|---|---|
| Nile | 6650 | Africa |
| Amazon | 6400 | South America |
Community examples
- Example: use of Web Request and Iterate Web Request with the Community forum API (Project; Module: Main; Group: Tab 1;
Table: Recently active users; Action position: 9) - Create a new table with columns based on row values (Project; Module: Main; Group: Tab 1; Table: Table 1; Action position: 3)
- Dynamical genereting of path based on previous step (Project; Module: Main; Group: Tab 1; Table: Calculate folder paths;
Action position: 4) - How to process parent-child data structures (Project; Module: Module 1; Group: Tab 1; Table: Longest folder path; Action position: 2)