transformations:merge
Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
transformations:merge [2021/04/05 00:33] – craigt | transformations:merge [2024/04/11 23:55] (current) – add inner join craigt | ||
---|---|---|---|
Line 5: | Line 5: | ||
\\ | \\ | ||
=====Description===== | =====Description===== | ||
- | This action appends one or more columns from another table where the values in certain columns in both tables match. | + | This action appends one or more columns from another table where the values in certain columns in both tables match. The action is similar to the SQL join. |
- | There are three possible merge modes:\\ | + | There are four possible merge modes:\\ |
====Lookup Mode==== | ====Lookup Mode==== | ||
Line 16: | Line 16: | ||
\\ | \\ | ||
====Full Join Mode==== | ====Full Join Mode==== | ||
- | Include all combinations of keys from both tables. | + | Include all combinations of keys from both tables. |
\\ | \\ | ||
- | =====Limitations===== | + | ====Inner Join Mode==== |
- | The resulting table after Merge can't have more than 134, | + | Include only matching |
\\ | \\ | ||
Line 27: | Line 26: | ||
* (Left Join Mode) Blend in additional data from other tables into the primary dataset. | * (Left Join Mode) Blend in additional data from other tables into the primary dataset. | ||
* (Full Join Mode) Combine two entire datasets to be cleaned and consolidated downstream. | * (Full Join Mode) Combine two entire datasets to be cleaned and consolidated downstream. | ||
+ | * (Inner Join Mode) Connect only rows from both tables where the values in the selected fields match. | ||
\\ | \\ | ||
Line 33: | Line 33: | ||
|Add columns from table|Select table that will return columns to the current dataset where values match.| | |Add columns from table|Select table that will return columns to the current dataset where values match.| | ||
|Where all these columns match|Select the columns within the current dataset (left drop-down) and the second dataset (right drop-down) where\\ values will match. | |Where all these columns match|Select the columns within the current dataset (left drop-down) and the second dataset (right drop-down) where\\ values will match. | ||
- | |Merge mode|Options: | + | |Merge mode|Options: |
|Return columns|From the list, select the columns from the second dataset that will be appended to the current dataset.| | |Return columns|From the list, select the columns from the second dataset that will be appended to the current dataset.| | ||
The reference to the second table will appear as a dotted line connecting this action to the second dataset in the application window. | The reference to the second table will appear as a dotted line connecting this action to the second dataset in the application window. | ||
+ | |||
+ | \\ | ||
+ | =====Remarks===== | ||
+ | Matching is case-sensitive. | ||
+ | |||
+ | Values must be identical (equal) in order to be matched. If another matching mode is needed (e.g. " | ||
+ | |||
+ | For an inner join use the [[transformations: | ||
+ | |||
\\ | \\ | ||
Line 41: | Line 50: | ||
- | **Objective:** Merge the " | + | **Example:** Merge the " |
**Table 1:** The longest rivers in the world\\ | **Table 1:** The longest rivers in the world\\ | ||
Line 62: | Line 71: | ||
> Add columns from table: Table 2 | > Add columns from table: Table 2 | ||
- | > Where values in the Table 1 " | + | > Where values in Table 1 " |
> Merge mode: Left join (add all matching rows from Table 2 to Table 1) | > Merge mode: Left join (add all matching rows from Table 2 to Table 1) | ||
> Return column: Outflow | > Return column: Outflow | ||
\\ | \\ | ||
- | **Result: | + | **Result |
^River | ^River | ||
Line 75: | Line 84: | ||
| Mississippi | | Mississippi | ||
+ | \\ | ||
+ | ====Community examples==== | ||
+ | * [[https:// | ||
+ | * [[https:// | ||
+ | * [[https:// | ||
+ | * [[https:// | ||
+ | * [[https:// | ||
\\ | \\ | ||
Line 80: | Line 96: | ||
* [[transformations: | * [[transformations: | ||
* [[transformations: | * [[transformations: | ||
+ | * [[transformations: | ||
transformations/merge.txt · Last modified: 2024/04/11 23:55 by craigt