transformations:removeemptycolumns
This is an old revision of the document!
Remove empty columns
This action removes columns with little or no meaningful information. It has three modes:
- Remove columns where all values are empty values - removes columns that only contain empty values (nulls)
- Remove columns where all values are empty or whitespace - removes columns that contain either empty or whitespace values (e.g. values with only spaces, line breaks, or tabs but no visible characters)
- Remove columns where all values are the same - removes columns where all values are the same, e.g. when a column contains only text value "N/A" in all rows.
The action can be helpful, for instance, after importing spreadsheets with sparsely located tables, or where table position changes from a file to file. It can also be used to remove columns that only contain null replacement values, such as "NULL".
Example
Source dataset:
Column 1 | Product name | Column 2 | Qty | Column 3 | Price |
---|---|---|---|---|---|
Big thing | 1 | 1000 | |||
Medium thing | 10 | 100 | |||
Small thing | 100 | 10 |
Objective: remove empty columns.
Result:
Product name | Qty | Price |
---|---|---|
Big thing | 1 | 1000 |
Medium thing | 10 | 100 |
Small thing | 100 | 10 |
transformations/removeemptycolumns.1539172273.txt.gz · Last modified: 2018/10/10 07:51 by dmitry