User Tools

Site Tools


transformations:filterbytype

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
transformations:filterbytype [2021/04/26 00:21] craigttransformations:filterbytype [2021/07/19 02:14] (current) – [Examples] craigt
Line 10: Line 10:
 =====Use cases===== =====Use cases=====
 Filtering by type helps detect data quality issues by ensuring that columns in the exported dataset are strongly typed (i.e. all values in a column are of the same type). This might be required before exporting into a target system with strongly typed fields, such as a relational database or a Tableau data extract. Filtering by type helps detect data quality issues by ensuring that columns in the exported dataset are strongly typed (i.e. all values in a column are of the same type). This might be required before exporting into a target system with strongly typed fields, such as a relational database or a Tableau data extract.
- 
-The //Filter by type// action is frequently followed by the [[transformations:halt|Halt on condition]] action that stops project execution if filtering returned a non-empty table with values of undesired types.\\ 
  
 \\  \\ 
Line 18: Line 16:
 |Filter mode|Select whether to keep or remove values of the types specified.  Options:  //Keep only values of selected type(s)// or\\ //Remove values of the selected types//.| |Filter mode|Select whether to keep or remove values of the types specified.  Options:  //Keep only values of selected type(s)// or\\ //Remove values of the selected types//.|
 |Data types|Select the data types to be filtered by.  Options:  //Text//, //Number//, //Boolean//, //Error//, and //Empty (null)//. | |Data types|Select the data types to be filtered by.  Options:  //Text//, //Number//, //Boolean//, //Error//, and //Empty (null)//. |
-|Columns to check|Select whether to check the entire table or specific columns.  Options:  //Entire table// or //Particular columns// (and\\ select the columns check).|+|Columns to check|Select whether to check the entire table or specific columns.  Options:  //Entire table// or //Particular columns// (and\\ select the columns to check).|
  
 \\ \\
Line 28: Line 26:
 \\  \\ 
 =====Examples===== =====Examples=====
-**Objective:**  Filter out all non-numberic values in the "Length (km)" column.\\+**Example:**  Filter out all non-numberic values in the "Length (km)" column.\\
  
 **Source table:** The longest rivers in the world **Source table:** The longest rivers in the world
Line 46: Line 44:
 > Columns to check; Particiular columns:  "Length (km)" > Columns to check; Particiular columns:  "Length (km)"
 \\  \\ 
-**Result:**+**Result table:**
 ^River  ^Length (km)  ^Continent  ^ ^River  ^Length (km)  ^Continent  ^
 | Nile  |  6650| Africa  | | Nile  |  6650| Africa  |
Line 54: Line 52:
 | Yellow River  |  5464| Asia  | | Yellow River  |  5464| Asia  |
 | Ob  |  5410| Asia  | | Ob  |  5410| Asia  |
 +
 +\\ 
 +====Community examples====
 +  * [[https://community.easymorph.com/t//2653/1|Extracting all projects published in the Community and their actions]] ([[https://community.easymorph.com/uploads/short-url/mrnJQUJJL8Do1T8ioicyzE1VgmK.morph|Project]]; Module: //Get projects//; Group: //Tab 1//; Table: //Project links//; Action position: //4//)
  
 \\  \\ 
Line 60: Line 62:
   * [[transformations:filter|Filter by condition]]   * [[transformations:filter|Filter by condition]]
   * [[transformations:searchfilter|Filter by search]]   * [[transformations:searchfilter|Filter by search]]
 +  * [[transformations:haltontypemismatch|Halt on data type mismatch]]
transformations/filterbytype.txt · Last modified: 2021/07/19 02:14 by craigt

Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki