User Tools

Site Tools


transformations:exportdataset

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
transformations:exportdataset [2021/05/08 01:10] craigttransformations:exportdataset [2023/11/24 20:01] (current) – [Remarks] craigt
Line 5: Line 5:
 \\  \\ 
 =====Description===== =====Description=====
-This action exports a dataset (tabular data) into a file in the native EasyMorph format (.dset). The native format allows very fast loading of the data into EasyMorph as there is no data conversion.+This action exports a dataset (tabular data) into a file in the native EasyMorph format (.dset) that is stored either locally or on EasyMorph Server. The native format allows very fast writing as well as loading of the data into EasyMorph as there is no data conversion.
  
 One .dset file contains one dataset.\\ One .dset file contains one dataset.\\
Line 12: Line 12:
 =====Use cases===== =====Use cases=====
 When working with large datasets that require significant load times, converting the source tables to .dset files and loading those into the workflow can increase overall process performance.\\ When working with large datasets that require significant load times, converting the source tables to .dset files and loading those into the workflow can increase overall process performance.\\
 +
 +Exporting a dataset into a .dset file that is stored on EasyMorph Server or is encrypted can be more secure than saving it into a CSV file or a spreadsheet.
  
 \\  \\ 
Line 33: Line 35:
 |Encrypt columns|When checked, one or more columns in the dataset will be encrypted and require a password to access.\\  See the "Encrypt columns options" below for details.| |Encrypt columns|When checked, one or more columns in the dataset will be encrypted and require a password to access.\\  See the "Encrypt columns options" below for details.|
 <sup>*</sup> Setting can be specified using a [[:parameters|parameter]].\\ <sup>*</sup> Setting can be specified using a [[:parameters|parameter]].\\
 +
 +\\ 
 +====Encrypt columns options====
 +^Option ^Description ^
 +|Password| Provide the password that will be required to access the encrypted data.|
 +|Encrypt columns|Select whether to encrypt all columns in the .dset file, or just selected columns (and choose which columns to encrypt).|
 +
 +\\
 +====Mode options====
 +^Option ^Description ^
 +|Create or overwrite|This option will create a new dataset file (if one doesn't already exist) or overwrite the file if it already exists.|
 +|Append or create|This open will create a new dataset file (if one doesn't already exist) or append rows to an existing file.|
 +
 \\  \\ 
-====File already exists options====+====Create or overwrite options==== 
 +//If a file with such name already exists//
 ^Option ^Description ^ ^Option ^Description ^
 |Overwrite|The new file replaces the original file.| |Overwrite|The new file replaces the original file.|
 |Rename|The original file will be renamed with "backup" and a serial number appended to the file name.  The new file will\\ possess the name specified in the //File// or //Path// setting.| |Rename|The original file will be renamed with "backup" and a serial number appended to the file name.  The new file will\\ possess the name specified in the //File// or //Path// setting.|
 |Halt project execution|The project will stop processing and this action will display a warning symbol.| |Halt project execution|The project will stop processing and this action will display a warning symbol.|
 +
 \\  \\ 
-====Encrypt columns options====+====Append or create options==== 
 +//If appended data contains new columns//
 ^Option ^Description ^ ^Option ^Description ^
-|PasswordProvide the password that will be required to access the encrypted data.| +|Add new columns|This option will add columns from the exported file that are not found in the existing dataset file.| 
-|Encrypt columns|Select whether to encrypt all columns in the .dset file, or just selected columns (and choose which columns to encrypt).|+|Ignore new columns and warn|This option will ignore (not append) columns in the exported file that are not found in the existing dataset file, display a warning, and the workflow will continue running.| 
 +|Halt project execution|The project will stop processing and this action will display a warning symbol.|
  
-\\ +\\ \\ 
 =====Remarks===== =====Remarks=====
 When importing a dataset (.dset) file with encrypted columns, the [[transformations:importdataset|Import dataset]] action icon will initially appear with a warning symbol and no data will show in the data grid.  Enter the //Password// in the action settings to decrypt and view all columns. When importing a dataset (.dset) file with encrypted columns, the [[transformations:importdataset|Import dataset]] action icon will initially appear with a warning symbol and no data will show in the data grid.  Enter the //Password// in the action settings to decrypt and view all columns.
Line 51: Line 70:
 If you do not have access to a dataset's password, select //Load only selected columns// and scroll down the dataset's column list.  Encrypted columns will appear with "lock" next to their names.  Select only unencrypted columns and click "Apply" to display those columns' data in the data grid.\\ If you do not have access to a dataset's password, select //Load only selected columns// and scroll down the dataset's column list.  Encrypted columns will appear with "lock" next to their names.  Select only unencrypted columns and click "Apply" to display those columns' data in the data grid.\\
  
 +:!: The encryption password can't be recovered. If it's lost, all the data encrypted with the password will become inaccessible.
 +
 +\\ 
 +When appending rows to a target file on EasyMorph Server, this action will fail if another workflow modifies the file before appending finishes.
 +\\ 
 +=====Community examples=====
 +  * [[https://community.easymorph.com/t//1769/1|How to do recursive loops in EasyMorph]] ([[https://community.easymorph.com/uploads/short-url/qM6kmqrDRWiEDJFljIa2u6QWre1.morph|Project]]; Module: //Main//; Group: //Tab 1//; Table: //Data//; Action position: //2//)
 +  * [[https://community.easymorph.com/t//1854/2|Product of Rows in a Column]] ([[https://community.easymorph.com/uploads/short-url/8o7F1FHzlEr0hUV2BgCLFNEMKqk.morph|Project]]; Module: //Multiply line//; Group: //Tab 1//; Table: //Imported table 1//; Action position: //3//)
 +  * [[https://community.easymorph.com/t//2653/1|Extracting all projects published in the Community and their actions]] ([[https://community.easymorph.com/uploads/short-url/mrnJQUJJL8Do1T8ioicyzE1VgmK.morph|Project]]; Module: //Main loop//; Group: //Group 1//; Table: //Actions//; Action position: //5//)
  
 \\  \\ 
transformations/exportdataset.txt · Last modified: 2023/11/24 20:01 by craigt

Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki