overview
Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revisionNext revisionBoth sides next revision | ||
overview [2019/10/31 08:59] – [EasyMorph Server] dmitry | overview [2021/01/14 19:02] – [Derived tables] dmitry | ||
---|---|---|---|
Line 3: | Line 3: | ||
==== Data import ==== | ==== Data import ==== | ||
- | In order to start transforming data in EasyMorph, all data subject to manipulations has to be imported into EasyMorph. As of version 4.0 EasyMorph can import the following data sources/ | + | In order to start transforming data in EasyMorph, all data subject to manipulations has to be imported into EasyMorph. As of version 4.5 EasyMorph can import the following data sources/ |
- | * Native database drivers (Oracle, MS SQL Server, MySQL, PostgreSQL, SQLite) | + | * Native |
- | * ODBC drivers | + | |
* REST APIs (JSON/XML) | * REST APIs (JSON/XML) | ||
* Text files with delimiters (e.g. CSV) | * Text files with delimiters (e.g. CSV) | ||
* Text files with fixed width columns | * Text files with fixed width columns | ||
* Excel spreadsheets (.xlsx, .xlsm, .xls) | * Excel spreadsheets (.xlsx, .xlsm, .xls) | ||
- | * XML files | + | * XML and JSON files |
* Google Sheets | * Google Sheets | ||
* SharePoint lists | * SharePoint lists | ||
Line 22: | Line 21: | ||
Databases can be queried using the visual Query Editor which is intended for users that don't know SQL. | Databases can be queried using the visual Query Editor which is intended for users that don't know SQL. | ||
- | Files can be loaded by simply dragging them into EasyMorph. | + | Files can be loaded by simply dragging them into EasyMorph. |
+ | |||
+ | [[https:// | ||
+ | [[https:// | ||
==== Actions ==== | ==== Actions ==== | ||
- | All manipulations with tables are done with the help of various [[[[transformations: | + | All manipulations with tables are done with the help of various [[[[transformations: |
* [[transformations: | * [[transformations: | ||
Line 35: | Line 38: | ||
{{:: | {{:: | ||
- | Actions are executed consequently, | + | Actions are executed consequently, |
- | The final state (or result) of a table is the result of all actions of this table applied consequently, | + | The final state (result) of a table is the result of all actions of this table applied consequently, |
Some actions (e.g. [[transformations: | Some actions (e.g. [[transformations: | ||
==== Expressions ==== | ==== Expressions ==== | ||
- | Some actions can use [[syntax: | + | Some actions can use [[syntax: |
+ | |||
+ | As of version 4.5 EasyMorph more than 130 functions can be used in expressions: | ||
+ | |||
+ | * [[syntax: | ||
+ | * [[syntax: | ||
+ | * [[syntax: | ||
+ | * [[syntax: | ||
+ | * [[syntax: | ||
+ | * [[syntax: | ||
+ | * [[syntax: | ||
==== Derived tables ==== | ==== Derived tables ==== | ||
- | Derived tables | + | Derived tables |
- | Since you can derive any number of tables from a table, and then keep transforming every derived table in its own way, you can create non-linear action chains. For instance, you can produce two derived tables from a table, transform each of them in its own way and then append or merge them back into one table. | + | Since you can derive any number of tables from a table and then keep transforming every derived table in its own way, you can create non-linear action chains. For instance, you can produce two derived tables from a table, transform each of them in its own way and then append or merge them back into one table. |
- | Derived tables can be calculated // | + | Derived tables can be calculated // |
+ | [[https:// | ||
==== Data export ==== | ==== Data export ==== | ||
Exporting data is performed using export actions. They can be inserted at any point of workflow. Export actions do not modify tables, they just export them into specified file format or external system. Therefore the output of an export action is always exactly the same as the input. | Exporting data is performed using export actions. They can be inserted at any point of workflow. Export actions do not modify tables, they just export them into specified file format or external system. Therefore the output of an export action is always exactly the same as the input. | ||
- | As of version 4.0 EasyMorh can export into the following data formats and systems: | + | As of version 4.5 EasyMorh can export into the following data formats and systems: |
- | * Native database drivers (Oracle, MS SQL Server, MySQL, PostgreSQL, SQLite) | + | * Native |
- | * ODBC drivers | + | |
* REST APIs (JSON/XML) | * REST APIs (JSON/XML) | ||
* Text files with delimiters (e.g. CSV) | * Text files with delimiters (e.g. CSV) | ||
Line 63: | Line 76: | ||
* XML files (.xml) | * XML files (.xml) | ||
* Google Sheets | * Google Sheets | ||
- | * Tableau extracts (.tde) | + | * Tableau extracts (.tde, .hyper) |
+ | * Power BI datasets | ||
* Qlik data files (.qvd) | * Qlik data files (.qvd) | ||
* EasyMorph datasets (.dset) | * EasyMorph datasets (.dset) | ||
- | ==== Automation | + | ==== Workflow automation |
- | EasyMorph workflows can have following automation: | + | EasyMorph workflows can perform external actions, for instance: |
* File and folder operations (copy/ | * File and folder operations (copy/ | ||
* Running external applications, | * Running external applications, | ||
Line 74: | Line 88: | ||
* Embedded PowerShell scripting | * Embedded PowerShell scripting | ||
+ | A workflow can be composed using advanced patterns: | ||
+ | * FOR..EACH type of loops (iterations) | ||
+ | * DO..WHILE/ | ||
+ | * IF..THEN..ELSE type of conditional branching | ||
+ | * Subroutines | ||
+ | * Error recovery | ||
+ | |||
+ | Workflows can have complex hierarchical structure when a project can consist of multiple modules, and each module can consist of multiple table groups. Such a structure allows designing and navigating workflows with hundreds of transformation steps (actions). | ||
==== Integration with external systems ==== | ==== Integration with external systems ==== | ||
EasyMorph workflows can also integrate and interact with external systems and applications. | EasyMorph workflows can also integrate and interact with external systems and applications. | ||
Line 85: | Line 107: | ||
| Google Drive | Download / upload files | | | Google Drive | Download / upload files | | ||
| Amazon S3 | Download / upload files | | | Amazon S3 | Download / upload files | | ||
- | | Tableau Server / Online | + | | Power BI | Publish push-datasets, |
+ | | Tableau Server / Online | ||
| Qlik Sense | Trigger task reloads | | | Qlik Sense | Trigger task reloads | | ||
| SSH | Execute commands | | SSH | Execute commands | ||
+ | |||
==== Auto-documentation ==== | ==== Auto-documentation ==== | ||
EasyMorph can automatically generate human-readable documentation in plain English for current project. Read more about [[documentation|Auto-documentation]]. | EasyMorph can automatically generate human-readable documentation in plain English for current project. Read more about [[documentation|Auto-documentation]]. | ||
==== Scheduling ==== | ==== Scheduling ==== | ||
- | [[https:// | + | [[https:// |
==== Command-line execution ==== | ==== Command-line execution ==== | ||
- | EasyMorph projects can be executed from command line thus allowing integration with third-party applications. Read more about [[command_line|command line parameters]]. | + | EasyMorph projects can be executed from the command line thus allowing integration with third-party applications. Read more about [[command_line|command line parameters]]. |
+ | |||
+ | A more robust integration option is the " | ||
==== EasyMorph Server ==== | ==== EasyMorph Server ==== | ||
[[https:// | [[https:// | ||
+ | |||
+ | ==== EasyMorph Community ==== | ||
+ | |||
+ | The [[https:// | ||
+ | |||
**See also:** | **See also:** | ||
* [[https:// | * [[https:// | ||
* [[https:// | * [[https:// | ||
- | * [[https:// | + | * [[https:// |
+ | * [[https:// |
overview.txt · Last modified: 2022/07/22 04:36 by dmitry