transformations:exportapacheparquet
Table of Contents
EXPORT TO APACHE PARQUET
Category: Export / File
Description
This action exports the current dataset into an Apache Parquet (.parquet) file with metadata.
Action settings
| Setting | Description |
|---|---|
| File* | Enter fully-qualified filename to save the dataset to. |
| Columns | Select the dataset columns to export, and select the columns' associated data types. Choose how EasyMorph responds if cell data type doesn't match the selected one (Fail, or Write null (if nulls are allowed)). |
| Metadata | Add Name/Value* metadata pairs to export along with the dataset. |
| Options | Select the Compression method as well as how EasyMorph handles situations if a file already exists (Overwrite, Rename, or Halt project execution). |
* Setting can be specified using a parameter.
Column data type settings
| Setting | Description |
|---|---|
| Data type | Select the data type of values in this column. Options: Text, 64-bit integer, Float, Double, Boolean, UUID, or Timestamp. |
| Can be null | Check this if the column can contain null values. |
File already exists options
| Option | Description |
|---|---|
| Overwrite | The new file replaces the original file. |
| Rename | The original file will be renamed with "backup" and a serial number appended to the file name. The new file will possess the name specified in the File setting. |
| Halt project execution | The project will stop processing and this action will display a warning symbol. |
See also
transformations/exportapacheparquet.txt · Last modified: 2024/06/08 19:27 by craigt