Templated File Transformations allow you to ensure that your data is in the appropriate format needed for collaboration, by transforming your data post-import to add, remove, or modify columns/values. 

This service is delivered as a custom templated script created by our solutions team, that is made available on your account after data import.

File Transformations can be used to:

• Add new columns (e.g. datetime columns to publish to your Dataset incremental data updates/expires, or a column that is the sum of other columns)
• Join groups of files together based on a shared key (e.g. for example SKUID, where the product description is in a separate file)
• Pivot data
• Group data by collapsing rows (e.g. transform transaction level data into customer level data)
• Clean data (e.g. remove trailing aliases from email columns)
• Change the data format (e.g. parquet to csv)

Managed service process

During the data preparation process, you and your InfoSum representative will discuss your data availability and needs and File Transformations might be brought up as an option if it matches your requirements. 

If that’s the case, a solutions representative will be involved to understand the ideal end-state of your data, create a custom transformation script and make it available for you.

Implementing File Transformations

With their advice, you should then import your data files into your Cloud Vault.

Once the files are available in the Cloud Vault, from the Cloud Vault page please click on the ‘Transform Files’ button on the top actions menu. If you don’t see this button please let your InfoSum representative know. 

This will open the File Transformations UI, where you will be able to:

1. Select the template that our solutions team has built for you
2. Add the name of the files that you want to transform. Please include the full name alongside the extension (e.g. .csv)
3. As part of the transformation we will create a recordset as an output, which is a file that includes detailed metadata about the formatting that can be understood by our platform 

Your Solutions representative will assist you to make sure that everything has been transformed appropriately. 

Next steps

After the File Transformations script has run, you will find a recordset in your Cloud Vault that is ready for normalization.