Data-flo
Data-floSource CodeCGPS
  • INTRODUCTION
    • What is Data-flo
    • Getting Started - Sign In
    • Privacy and Terms Of Service
    • Contact - Help & reporting errors
    • Change log
  • USING DATA-FLO
    • Data-flo site navigation
      • Transformations Page
      • Run Page
      • Canvas
    • Data
      • Bringing data in to Data-flo
      • Getting data out of Data-flo
      • Data Types
        • Boolean
        • Datatable
        • File
        • Graph
        • List
        • Map
        • Number
        • Text
    • Regular Expressions (RegEx)
    • Adaptors overview
      • Components of an adaptor
      • Binding types
        • Bind to Data-flo input
        • Bind to value
        • Bind to another transformation
    • Specific adaptors
      • add-column
      • append-to-list
      • calculate-time-difference
      • change-column-case
      • columns-concatenation
      • concatenate-text
      • create-microreact-project
      • csv-file-to-datatable
      • csv-to-datatable
      • datatable-columns
      • datatable-to-csv-file
      • datatable-to-graph
      • datatable-to-list
      • datatable-to-map
      • datatable-to-sqlite-file
      • date-to-text
      • dbf-file
      • dot-to-graph
      • download-file
      • dropbox-file
      • epicollect-project
      • extend-datatable
      • figshare-file
      • file-to-text
      • filter-blank-values
      • filter-columns
      • filter-list
      • filter-rows
      • filter-rows-numerically
      • force-directed-layout
      • format-date-column
      • forward-geocoding
      • ftp-file
      • gather-rows
      • google-drive-file
      • google-spreadsheet
      • graph-to-dot
      • join-datatables
      • list-to-datatable
      • lookup-map-value
      • merge-datatables
      • merge-lists
      • microreact-project
      • mysql-database
      • newick-leaf-labels
      • oracle-database
      • postgress-database
      • prepend-to-list
      • remove-columns
      • remove-duplicate-rows
      • rename-columns
      • replace-blank-values
      • replace-column-values
      • replace-text
      • replace-text-in-list
      • replace-value
      • reverse-geocoding
      • row-column-value
      • s3-file
      • select-columns
      • send-email-message
      • slice-datatable
      • slice-list
      • smb-file
      • sort-datatable
      • sort-list
      • split-column
      • split-datatable-rows
      • split-list
      • split-text
      • spread-rows
      • spreadsheet-file
      • sql-server-database
      • sqlite-database
      • sum-rows
      • text-template
      • text-to-file
      • unique-list-items
      • update-epicollect-entries
      • update-microreact-project
      • update-smb-file
      • upload-file-to-google-drive
      • upload-files-to-google-drive
      • url-builder
      • yaml-to-json
    • Building a data-flo
      • Debugging mode
      • Show detailed errors on Run Page
      • Permissions - Access Control
    • Tips & Tricks
  • TUTORIALS
    • Prep outbreak data for Microreact
    • Common use cases, solved
      • Fixing datatable headers
      • Select, remove, rename, reorder columns
      • Data in separate files
      • There's no single-column unique row ID (primary key)
      • Ensure non-dates stay non-dates
      • Connect directly to a database
      • Access files on a drive
Powered by GitBook
On this page
  • Adaptors are multifunctional
  • Using Select-columns
  • Using Remove-columns
  • Using Rename-columns

Was this helpful?

  1. TUTORIALS
  2. Common use cases, solved

Select, remove, rename, reorder columns

There are multiple ways to tell Data-flo which columns to send to output, and in what order.

PreviousFixing datatable headersNextData in separate files

Last updated 2 years ago

Was this helpful?

Adaptors are multifunctional

Use to

  • choose columns

  • set the order of columns

Use to

  • choose columns

  • no change to order of columns

Use **** to

  • rename some columns (or all columns)

  • keep or discard remaining columns

  • no change to order of columns

TIP: Use with and "" to enable users to define the columns from the .

Using Select-columns

Keeping most? Highlight and copy the column headers from the data. Paste them into the columns argument, where they become a list. Delete any column names from the list that you don't want to keep. Use this instead of Remove-columns if you want to change the order of columns in the output.

When working with a list of key-value pairs or columns, using <control> or <command> with the up/down arrow keys will move the selected item to the top or bottom of the list. TIP: use the adaptor as an input to the column argument in Select-columns, if you want to sort alphabetically.

Using Remove-columns

Highlight and copy the column headers to remove, and paste into the column argument using "Bind to a value". It auto-transforms the copied columns to a list of columns to remove.

Using Rename-columns

This adaptor can be used to rename a single column, or all columns, or a subset of columns, using a mapping of old column names to new column names. Columns excluded from the map can be discarded or included with their original names.

The Rename-columns adaptor has a discard argument, which allows you to remove all columns that are not mapped in the renaming mapping argument. Thus, you can map all the columns you want to keep (even if their names are not changing) and leave discard set to 'true' (this is the default setting).

One method: Run the data-flo in Debugger Mode to make data visible. Copy the headers from the data visible when you click on the CSV argument. paste into excel & transpose, then in next column do same with new header names, then copy all and paste the whole list into key-value pair area. Check whether this is necessary or if can paste right into key-list only or value-list only Specify column order in Data-flo output: Sort datatable is equivalent to an order by statement if you need that.

TIP: Rename columns early in the data-flo to simplify other transformations, such as .

Select-columns
Remove-columns
Rename-columns
Datatable-columns
Bind to Data-flo input
Run Page
Sort-list
Join-datatables
Unmapped columns are discarded by default in Rename-columns adaptor