User Tools

Site Tools


transformations:filterbytype

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
Last revisionBoth sides next revision
transformations:filterbytype [2021/04/26 00:21] craigttransformations:filterbytype [2021/07/15 11:51] craigt
Line 10: Line 10:
 =====Use cases===== =====Use cases=====
 Filtering by type helps detect data quality issues by ensuring that columns in the exported dataset are strongly typed (i.e. all values in a column are of the same type). This might be required before exporting into a target system with strongly typed fields, such as a relational database or a Tableau data extract. Filtering by type helps detect data quality issues by ensuring that columns in the exported dataset are strongly typed (i.e. all values in a column are of the same type). This might be required before exporting into a target system with strongly typed fields, such as a relational database or a Tableau data extract.
- 
-The //Filter by type// action is frequently followed by the [[transformations:halt|Halt on condition]] action that stops project execution if filtering returned a non-empty table with values of undesired types.\\ 
  
 \\  \\ 
Line 18: Line 16:
 |Filter mode|Select whether to keep or remove values of the types specified.  Options:  //Keep only values of selected type(s)// or\\ //Remove values of the selected types//.| |Filter mode|Select whether to keep or remove values of the types specified.  Options:  //Keep only values of selected type(s)// or\\ //Remove values of the selected types//.|
 |Data types|Select the data types to be filtered by.  Options:  //Text//, //Number//, //Boolean//, //Error//, and //Empty (null)//. | |Data types|Select the data types to be filtered by.  Options:  //Text//, //Number//, //Boolean//, //Error//, and //Empty (null)//. |
-|Columns to check|Select whether to check the entire table or specific columns.  Options:  //Entire table// or //Particular columns// (and\\ select the columns check).|+|Columns to check|Select whether to check the entire table or specific columns.  Options:  //Entire table// or //Particular columns// (and\\ select the columns to check).|
  
 \\ \\
Line 54: Line 52:
 | Yellow River  |  5464| Asia  | | Yellow River  |  5464| Asia  |
 | Ob  |  5410| Asia  | | Ob  |  5410| Asia  |
 +
 +\\ 
 +====Community examples====
 +  * [[https://community.easymorph.com/t//2653/1|Extracting all projects published in the Community and their actions]] ([[https://community.easymorph.com/uploads/short-url/mrnJQUJJL8Do1T8ioicyzE1VgmK.morph|Project]]; Module: //Get projects//; Group: //Tab 1//; Table: //Project links//; Action position: //4//)
  
 \\  \\ 
Line 60: Line 62:
   * [[transformations:filter|Filter by condition]]   * [[transformations:filter|Filter by condition]]
   * [[transformations:searchfilter|Filter by search]]   * [[transformations:searchfilter|Filter by search]]
 +  * [[transformations:haltontypemismatch|Halt on data type mismatch]]
transformations/filterbytype.txt · Last modified: 2021/07/19 02:14 by craigt

Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki