The import flow enables you to run an import of your data into your Cloud Vault via a simple-to-use process

There are two ways you can import data into a Cloud Vault:

1. Local file import: Please note this option does not support automated data onboarding
2. Server-based import consists of three objects
   1. Step 1: Cloud Vault: which serves as a container in which to manage your files
   2. Step 2: Import Connector Config (ICC): tells our server how to connect with the Server hosting your file given the details you provide
   3. Step 3: File Importer: to pull the file into your Cloud Vault using the details you entered during the ICC creation

After importing your file(s) to your Cloud Vault, the next step will be to create a Recordset.

How to start the Import Flow

From the Cloud Vault main screen select the Start an Import button in the top right of the screen. This will kick off the end-to-end import flow.

Local file import

A local file import is where the file you wish to upload to your Cloud Vault is located on your local machine.

Notes:

• Only CSV files can be imported
• The maximum file size that can be uploaded is 4GB
• You can select up to 10 files per upload (they will be queued and uploaded one at a time)
• You can run up to 5 local file uploads in parallel with anything more than 5 being queued
• Local File Import cannot be used for Automation

1) Click Start an Import

2) Choose Local File Import.

3-a) If you don’t yet have a Cloud Vault, click 'Create New Cloud Vault.'

Insert a name and select a region, then click the blue 'Create Cloud Vault' button.'. 

3-b) If you already have a Cloud Vault, click 'Use Existing Cloud Vault' and select one from the list before clicking 'Continue.' 

For more information on Cloud Vault management see 'Creating a Cloud Vault'

4) On the next dropdown menu, select your Cloud Vault, keeping “Import Location” as “Cloud Vault Root.”

5) Drag & Drop or Click and choose the file to upload.

Wait for your CSV file to import and complete.

6) Click Go To File and you will now be presented with your Cloud Vault containing the file that was uploaded 

7) The next step will be to create a Recordset

Server-based import

A server-based import is one where data is uploaded to a Cloud Vault from a server-based location. Please use this option if you wish to automate data onboarding.

1) From the Cloud Vault main screen, select the 'Start an Import' button in the top right of the screen.

2) Choose 'Server Import'.

There are three steps to Import a file from a server:

Step 1: Select or create the Cloud Vault

3) Click on step 1 'Select or Create: Cloud Vault.’

4-a) If it’s your first time importing your file, click 'Create New Cloud Vault.' Enter a 'Cloud Vault Name' and select a 'Region,' then click 'Create Cloud Vault.'

4-b) If you already have your existing Cloud Vault, click 'Use Existing Cloud Vault' and select one from the list of 'Cloud Vault', then click 'Continue'. 

For more information on Cloud Vault management see 'Creating a Cloud Vault'

Step 2: Select or Create an Importer Config Connector

1) Click on Step 2: Select or Create: Importer Connector Config

2-a) If you need to create a new ICC, click 'Create New ICC.' Give it a name and select your server provider or “Connector Type.” You can also enable GPG Encryption here if required.

For more information on how to create an ICC please read this article

Fill in required details for Connector Config, and click 'Next'

• Amazon S3 Access-Keys
• Amazon S3 Cross-Account
• Google Cloud Storage Connector
• SFTP

Note:

• The details for your Connector (server storage) must come from your team; InfoSum has no visibility into these credentials.
• If specifying a folder path in the Prefix field, please ensure you do not include any leading slashes ('/').

2b) If you already have your Importer Config Connector (ICC), click 'Use Existing ICC' and select one from the list of saved Import Connector Configs before clicking 'Continue.' 

Step 3: Create a File Importer

1) Click on Step 3: Create a File Importer

2) Give the Importer a name of your choosing and enter the name of the file as it is in your cloud storage, then hit ‘Submit.’

• If you want to import multiple files, separate each with a comma.
• If you want to set up an import automation cadence and each version of your file will have a modified name, you can use a wildcard (e.g., if your file name has the date appended to it, you can enter FileName*.csv).

Notes:

• As a reminder, InfoSum currently only supports CSV and Parquet file types.
• Currently, InfoSum can only support tasks for up to 1000 files. If your data is spread across multiple files, please ensure the file count does not exceed 1000.
• The AWS services that InfoSum utilizes can't accept Parquet files greater than 5GB. Please ensure each individual Parquet file is smaller than 5GB.
• InfoSum only supports Parquet files that use either snappy or GZIP compression in downstream tasks.
• InfoSum can't support a Parquet group size of more than 512MB.

4) You will now see your imported file(s) in the corresponding Cloud Vault. As a reminder, the file will not be managed by InfoSum but is yours to delete or refresh as you see fit according to your data retention policy.

Next step

The next step will be to create a Recordset