transformations:start
Table of Contents
Actions
All the actions available in EasyMorph:
Import / File
- Import dataset - import dataset from a file in the native EasyMorph data format (.dset).
- Import delimited text file - import data from a delimited text files (e.g. .csv).
- Import Excel spreadsheet - import data from Excel spreadsheets (.xls,.xlsx).
- Import fixed width text - import tabular data with fixed width columns from text file.
- Import from Apache Parquet - import columns or metadata from an Apache Parquet file.
- Import JSON from file - import JSON from a text file.
- Import plain text - import a text file as is without parsing.
- Import Qlik QVD file - import data or metadata from a QVD file.
- Import SAS file - import data from a SAS file (.sas7bdat).
- Import SPSS file - import data from a SPSS/PSPP file (.sav).
- Import XML file - import data from an XML file.
- Project metadata - project metadata such as list of connectors or parameters.
- Split delimited file - split large file into smaller chunks without loading it into EasyMorph.
Import / Database
- Import from database - import data from a database.
- Select matching database rows - import rows from a database table where key values match (or don't match) key values in an EasyMorph table.
Import / App & Cloud
- Import from Airtable - import a table from Airtable.
- Import from Google Analytics - import metrics from Google Analytics.
- Import from Google Search Console - import metrics from Google Search Console.
- Import from Jira - import information from Jira.
- Import from Microsoft Dataverse - import an entity or entity metadata from Microsoft Dataverse.
- Import from Pipedrive - import deals, organizations, persons from the Pipedrive CRM.
- Import from Power BI - import data from a Power BI semantic model.
- Import from Salesforce - import rows from a Salesforce object.
- Import from Zendesk - import ticket and user data from Zendesk.
- Import Google Sheets - import data from a Google Sheets spreadsheet.
- Import SharePoint list - import a SharePoint list.
Import / API
- Import from Web API - import data from a Web API.
- Incoming HTTP Request - receive an HTTP request from a custom API endpoint of EasyMorph Server.
- Incoming webhooks - import incoming webhook messages from EasyMorph Gateway.
Create / Generate
- Calendar - create a sequence of dates in specified date range
- Create list - create a list of up to 100 manually entered values
- List of files - create a list of files in specified folder
- List of folders - create a list of folders in specified folder
- Parameter table - creates a single-row table with parameter values as columns
- Sequence - generate a sequence of numbers from 1 to N
- System information - obtain system information (such as current Windows account or free RAM).
Create / Input
Transform / Basic
- Aggregate - calculate aggregates (subtotals) like sum or count grouped by one or more fields.
- Append another table - Append another table as new rows or columns.
- Calculate new column(s) - calculate new column with expression built using arithmetical operations and various functions.
- Clean up - remove particular values from one or more columns.
- Concatenate text - concatenate column values into delimited text.
- Convert data type - convert text dates into number dates.
- Enumerate rows - add column with row numbers.
- Keep/remove columns - retain or delete selected columns.
- Lookup - replace values in a column using a lookup table.
- Merge another table - merge (join) one or more columns from another table where certain columns in both tables match.
- Modify column(s) - replace existing column with a calculated expression.
- Peek - create a new column using a single value from another table.
- Rename columns - assign new names to selected columns.
- Reorder columns - rearrange the sequence of the columns within a dataset.
- Replace - replace particular values in a column with new ones.
- Rule - calculate or replace a column using multiple nested IF..THEN…ELSE conditions.
- Sort - sort table by one or more columns.
Transform / Advanced
- Anonymize/Hash - anonymizes data without affecting its cardinality.
- Compare tables - compares two tables and produces a list of differences based on column metadata.
- Create buckets - create ranges of fixed width and assign each row to one of the ranges.
- Cross merge - create a table with all possible combinations (i.e. Cartesian product) of rows in two tables.
- Distribute total - break down a total/subtotal proportionally to a group of numbers (weights).
- Enumerate groups - enumerate all combinations of values in given columns.
- Fill down - fill down empty cells.
- Fill right - fill empty cells to the right.
- Generate unique identifiers - creates a randomly generated global unique identifier for each row.
- Group - assign a group name (or flag) to selected column values.
- Hierarchy path - generate a parent-child hierarchy path.
- Interval merge - merge columns from another table where key values fall into an interval defined by two columns.
- Label columns - name columns using values from top rows.
- Linear regression - build a linear regression. Interpolate/extrapolate values if needed.
- Make date/time columns - create column(s) with date/time attributes derived from a date column.
- Match - find text strings in another table, that are contained in the current table.
- Natural merge - merges two tables based on columns with the same names.
- Pivot - create a matrix table by pivoting.
- Regular expression - create a new column with regular expression matches.
- Remove empty columns - remove columns where all values are the same or empty.
- Remove empty rows - remove rows where all values are empty or whitespace.
- Rename columns by lookup - rename multiple columns using a lookup table.
- Repeat rows - repeat each row as many times as specified in given column.
- Replace with lookup - replace all substrings in one or many columns using a lookup table.
- Roll up - adds amounts up through a hierarchy.
- Running total - calculate rank, cumulative count, sum or % from total sum.
- Sanitize text - remove hidden system characters, extra spaces, and line breaks.
- Select columns by lookup - select columns using a lookup table.
- Shift column up/down - shifts column values up or down.
- Sliding aggregation - calculates an aggregate (average, sum, etc.) over N sliding values.
- Split delimited text into columns - split delimited values of a column into new columns.
- Split delimited text into rows - split delimited values of a column into rows.
- Split fixed width text - split a column with fixed width text values into new columns.
- Statistical aggregation - calculate median, percentile, standard error, standard deviation, or variance.
- Table metadata - obtain column names, total row count and other table metadata.
- Table-wide replace - remove or replace values across selected columns.
- Total/subtotals - add column total or group subtotals as a new column.
- Unpivot - convert a matrix table into a straight table.
- Verify data in another table - perform multiple data quality checks on a table.
Transform / Filters
- Deduplicate rows - remove duplicate rows in entire table based on all or selected columns.
- Filter - filter rows by selecting/deselecting column values.
- Filter by condition - filter rows that satisfy expression.
- Filter by search - filter rows that contain (or don't contain) search string.
- Filter by type - keep or remove only rows with values of particular data type (e.g. errors).
- Keep duplicates - keep only duplicate rows based on all or selected columns.
- Keep min/max - keep/remove rows with the top N biggest/smallest values.
- Keep/remove matching - keep or remove rows with values that exist in another table.
- Trim table - keep/remove top/bottom N rows.
- Trim table by condition - keep/remove rows above/below first row matching condition.
Transform / Web
- Construct HTTP response - construct fields required for an HTTP response of the API Server.
- Construct JSON - construct a JSON object.
- Extract JSON properties - extract values of one or more JSON properties specified by JSON path.
- Modify JSON - delete, replace, or rename a JSON property or format JSON.
- Parse JSON - parse a JSON object into a tabular dataset.
- Parse web form submission - parse web form submissions in the "x-www-form-urlencoded" format.
- Parse XML - parse XML into a tabular dataset.
- Split JSON array - split a JSON array into rows.
Export / File
- Export dataset - export dataset into a file in the native EasyMorph data format (.dset).
- Export into delimited text file - export data into CSV or another delimited text format.
- Export into Excel file - export data into an Excel spreadsheet.
- Export as plain text - export a column as a plain text file without formatting or delimiting.
- Export into Qlik file - export data into a Qlik QVD file.
- Export to Apache Parquet - exports dataset into a file in the .parquet format.
- Export to Tableau - export data into a Tableau TDE/Hyper file or publish to Tableau Server/Online.
- Export to XML - export data into an XML file.
Export / Database
- Bulk export to database - bulk export into a database table (some RDBMS).
- Export to database - export EasyMorph table into database table (all RDBMS).
Export / App & Cloud
- Export to Airtable - export to a table in Airtable base.
- Export into Google Sheets - export data into a Google Sheets spreadsheet.
- Export to Power BI - export to Power BI push-dataset.
- Export to Salesforce - insert records into a Salesforce object.
- Export to SharePoint list - append rows to a SharePoint list.
- Export to Tableau - export data into a Tableau TDE/Hyper file or publish to Tableau Server/Online.
Workflow / Internal
- Breakpoint - stop project execution.
- Call another module/project - pass table data to another project and run it once.
- Call with another table - run another module or project, passing another table.
- Either table - between current table and another table choose one that is not empty.
- Halt on data type mismatch - abort project execution if a value in specified column(s) has a wrong type.
- Halt/Warn on condition - abort project execution, or display a warning and continue, if the specified condition is fulfilled.
- Iterate - run another module/project once for each row in table.
- Iterate column - run another module/project once for each column in table and automatically append all returned columns into one table.
- Iterate table - run another module/project once for each row in table and pass another table to it.
- Play sound - Play a system sound or .wav file.
- Raise issue - create a new issue in an Explorer board in EasyMorph Server.
- Repeat - run another module/project until/while its output is empty.
- Shared memory - perform operations on shared memory, a key-value data respository.
- Skip actions on condition - skip the rest of actions in table if the specified condition is fulfilled.
- Skip on condition in another table - skip the rest of the actions in table if the condition in another table is fulfilled.
- Start/finish exclusive access - enforce mutually exclusive access to a resource for simultaneously executed projects (tasks).
- Status - display custom project execution status message.
- Synchronize - wait until another table is calculated.
- To-do - add a to-do item to the workflow.
- Wait - pause execution for specified number of seconds.
Workflow / External
- Catalog command - list/create/update/delete Catalog directories, items, and item fields.
- Database command - create/delete/truncate DB table or send a custom SQL command to a database (e.g. to bulk load a file).
- Delete database rows - delete rows in a database table that satisfy query conditions.
- Delete matching database rows - delete rows in a database table where key values match/don't match key values in an EasyMorph table.
- Download file - download a file from the internet.
- Email command - performs various operations with email messages.
- Excel command - perform file/sheet operations and run VBA macros in Excel files.
- Fetch email - fetch email messages and their attachments from a mail server (Exchange or IMAP).
- File command - performs basic file operations such as copy/move/rename/delete/unzip.
- File transfer - transfer files over SFTP or SCP to or from a remote computer.
- Generate documentation - generate HTML documentation for an EasyMorph project.
- Iterate program - execute external application once for each row in a table.
- Iterate Web Request - send multiple uniform HTTP requests to a web API and append responses into one table.
- PowerShell - executes one or more PowerShell statements.
- Run program - execute external application once.
- Send email - send an email with an attachment to one or more recipients.
- SSH command - run one or several commands on a remote computer using the SSH protocol.
- Update database table - update a database table with values from EasyMorph.
- Web Request - send an HTTP request to a web API and receive a response.
- XSLT transformation - transform a given XML file using XSLT stylesheets.
Workflow / Apps and cloud
- Amazon command - perform an operation with AWS S3 , e.g. upload/download a file.
- Ask ChatGPT - sends free-form prompts to ChatGPT.
- Azure Blob Storage command - performs various file and folder operations with Azure Blob Storage.
- Dropbox command - performs various file and folder operations with Dropbox.
- EasyMorph Server command - trigger a task, or upload/download/delete a file on a remote EasyMorph Server.
- Google Drive command - perform an operation with Google Drive, e.g. download a file.
- Jira command - perform a Jira command.
- OneDrive command - perform file operations within OneDrive.
- Power BI command - trigger a Power BI action, such as refreshing a dataset or triggering a workflow.
- Qlik Cloud command - execute a Qlik Cloud command remotely.
- Qlik Sense command - execute a Qlik Sense command remotely.
- Send message to ntfy - send a message through ntfy.
- Send message to Pushover - send a message through the Pushover service.
- SharePoint command - perform file operations within SharePoint.
- Slack Bot - send notifications to Slack.
- Tableau Server command - trigger extract refresh or run a flow on Tableau Server / Online.
- Teams Bot - send a message to Microsoft Teams.
- Update/delete rows in Airtable - update or delete rows in Airtable.
- Update/delete records in Salesforce - update/delete records in a Salesforce object.
- Update/delete rows in SharePoint list - update or delete rows in a SharePoint list.
- Zendesk command - create, update, and delete Zendesk tickets.
If you need an action that is not currently available in EasyMorph please feel free to make a feature request on the Community forum.
transformations/start.txt · Last modified: 2024/10/27 20:34 by craigt