User Tools

Site Tools


transformations:removeemptycolumns

This is an old revision of the document!


Remove empty columns

This action removes columns with little or no meaningful information. It has three modes:

  • Remove columns where all values are empty values - removes columns that only contain empty values (nulls)
  • Remove columns where all values are empty or whitespace - removes columns that contain either empty or whitespace values (e.g. values with only spaces, line breaks, or tabs but no visible characters)
  • Remove columns where all values are the same - removes columns where all values are the same, e.g. when a column contains only text value "N/A" in all rows.

The action can be helpful, for instance, after importing spreadsheets with sparsely located tables, or where table position changes from a file to file. It can also be used to remove columns that only contain null replacement values, such as "NULL".

Example

Source dataset:

Column 1 Product name Column 2 Qty Column 3 Price
Big thing 1 1000
Medium thing 10 100
Small thing 100 10

Objective: remove empty columns.

Result:

Product name Qty Price
Big thing 1 1000
Medium thing 10 100
Small thing 100 10
transformations/removeemptycolumns.1539172273.txt.gz · Last modified: 2018/10/10 07:51 by dmitry

Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki