Differences

This shows you the differences between two versions of the page.

--- transformations:cleanup [2016/06/19 19:54] – created dmitry
+++ transformations:cleanup [2025/01/10 17:19] (current) – craigt
@@ Line 1: / Line 1: @@
-===== Clean up =====
+{{ transformations:CleanUpAction.png}}
+====== CLEAN UP ======
+Category: Transform / Basic\\
-Remove from column particular values or values of a particular type (e.g. text) by replacing them with empty cells. Unlike [[transformations:selectionfilter|Filter]] this transformation doesn't remove table rows.
+\\
+=====Description=====
+This action removes specified values, or values of a particular type (e.g. text), from one or more columns by replacing them with empty cells.\\
-**Use cases**
+\\
-Clean Up is used for dealing for data quality issues. E.g. removing text values from a column where only numbers are expected, or removing particular (garbage) values. Most typically, Clean Up is used when importing data from Excel spreadsheets.
+=====Use cases=====
+//Clean Up// is used for dealing with data quality issues - e.g. removing text values from columns where only numbers are expected, or removing specific undesired values. Most typically, //Clean Up// is used when importing data from Excel spreadsheets.\\
+\\
+=====Action settings=====
+^Setting^Description^
+|Column|Click the down arrow to choose which columns Clean Up will affect.  Options:  //Column// (and select a specific column), //All columns// (to clean the entire dataset), or //Selected columns// (and select which columns will be cleaned).|
+|Remove…|Select the types of values, or specific values, to be removed.  See below.|
+\\
+====Remove options====
+^Option^Description^
+|Remove numbers|All numeric values are removed.|
+|Remove everything but numbers|All numbers are kept; non-numeric values are removed.|
+|Remove text values|All text values are removed.|
+|Remove everything but text values|Text values are kept; non-text values are removed.|
+|Remove whitespace only values|Removes values containing only spaces.|
+|Remove errors|All error results are removed.|
+|Remove particular values|Options:  //Remove selected values// or //Remove all but selected//.  When selected, a list of all unique\\ values in the column is displayed for the user to manually select which values to keep or remove.|
+\\
+=====Remarks=====
+Unlike [[transformations:selectionfilter|Filter]], this transformation doesn't remove table rows.\\
+\\
+=====Examples=====
+====Example #1====
+>Clean non-numeric data from Sales column.
+===Before (source table)===
+^Salesperson  ^Sales  ^
+| Sveta |  11230|
+| Rick|Kiev  |
+| Dan  |  8290|
+| Yelena|#Error |
+===After (result table)===
+^Salesperson  ^Sales  ^
+| Sveta |  **11230**|
+| Rick| |
+| Dan  |  **8290**|
+| Yelena| |
+===Action parameters:===
+>  Columns to clean: Sales
+>  Option: Remove everything but numbers
+\\
+====Example #2====
+>Clean improper data from the Department column.
+===Before (source table)===
+^Department  ^Headcount  ^
+|Admin |  4|
+|  15|  15|
+|HR|  3|
+|*TBD*  |  0|
+|Sales|  4|
+===After (result table)===
+^Department  ^Headcount  ^
+|**Admin** |  4|
+|   |  15|
+|**HR** |  3|
+|  |  0|
+|**Sales** |  4|
+===Action parameters:===
+>  Columns to clean: Department
+>  Option: Remove everything but text values
+>  Option: Remove particular values ("TBD*)
+\\
+=====Community examples=====
+  * [[https://community.easymorph.com/t//1375/5|Example: Getting public holidays from an API with Web Request]] ([[https://community.easymorph.com/uploads/short-url/pL0iYCFfb1g8rGHfNBMZd1rAd8k.morph|Project]]; Module: //Main//; Group: //Tab 1//; Table: //Public holidays//;\\ Action position: //4//)
+  * [[https://community.easymorph.com/t//2017/3|Duplicating rows based on a condition]] ([[https://community.easymorph.com/uploads/short-url/blETeOO6qUVzskyO2eYqMiNvjPP.morph|Project]]; Module: //Main//; Group: //Tab 1//; Table: //Table 1 (2)//; Action position: //5//)
+\\
+=====Shortcuts=====
+Fast ways to create the action:\\
+  *Right-click a value and select "Clean Up".  Choose whether to "Keep only [value]" or "Remove [value]" from the submenu.
+\\
+=====See also=====
+  * [[transformations:Replace|Replace]]