Platform limits
The following sections describe the limits of InfoSum Platform.
Audiences / Queries
The maximum number of Datasets in query is 7
This includes:
- An Audience Builder query (drag and drop)
- IQL query (using the query tool)
Characters
- The category name has a limit of 200 characters
- We assume UTF-8 characters.
-
We support the following special characters in category names: - _ , . ' : ( )
- Please note that category names that have an apostrophe ['] on the name will need it to be a double apostrophe [''] to use the query tool
- We support “non-traditional” characters or letters, in keys such as accents é, è, ê, Umlaut ä, ö, ü, along with other language specific characters such as ñ, ç, č . We also support non-Latin characters like Arabic, Cyrillic, Greek, Thai.
- The character limit per key in a multi-value key field has been tested to beyond 2000 characters.
- The character limit per value in a multi-value category field has been tested to beyond 2000.
- Please note that we do not support multi-value integers and only support multi-value strings at the moment
- The character limit for a single value key has been tested to beyond 2000 characters
Columns
- The maximum number of columns has been tested to 3000 but will be lower when the Dataset has many millions of rows, as the complexity of the data increases. Please reach out to your InfoSum representative with a sample data schema to get advice and suggestions on how to best format and import the data.
- Although there is no specific limit to the number of keys in each Dataset we have tested up to 50 keys
- The maximum number of key values per key is 5 billion (see Dataset size limits for details)
- The maximum number of values per cell in a multi-value category is 100. During normalization, the platform will deduplicate the values and then remove any values that exceed 100
- The maximum number of multi-value keys per cell is 100. During normalization, the platform will deduplicate the values and then remove any values that exceed 100
- All Global Schema and Custom Keys can be multi-value
File types
- We support CSV and Parquet files imported from all sources
- We support importing folders containing files
- Multiple file parts can be imported from any source
- Multiple file parts forming the content of one directory can be uploaded as parts and processed into a single recordset after upload
-
Compression types supported:
- CSV: GZIP
- Parquet: snappy, GZIP -
Compression types NOT supported: windows rar and “zip”
- Files can be encrypted with GPG or PGP can be uploaded from any source except “local file uploads”.
- A file can be GZIPPED and then GPG/PGP encrypted before being imported, but cannot be GPG encrypted and then GZIPPED
File size
- For Parquet files:
- No single parquet file can exceed 5GB
- The group size cannot exceed 512MB
- If importing parquet files with multi-value fields from Snowflake, the Parquet file will not recognise the fields as multi-value (array data type) due to an issue with Snowflake exports. Please contact your InfoSum representative or InfoSum Support to allow us to assist you in getting around this issue.
- For CSV files:
- When using local file import, the maximum file size that can be uploaded is 4GB. You can upload up to 10 files at once and run up to 5 parallel uploads.
- For server imports we recommend keeping files under 20-30GB to avoid timeouts. If your files exceed this size, please split the file into smaller files. Further limits apply to SFTP servers
- The maximum file size for a Gzipped CSV is 5GB. If your files exceed this size, please split the file into smaller Gzipped files.
Multi-value key matching
- The Platform shows the matched audience total at each individual (row) level rather than at the identifier level
Output data
- The maximum number of output columns has been tested to be beyond 50. We recommend using the API to import Datasets with large numbers of output columns to minimize the manual process, as each output column must be tagged individually
- The maximum number of output columns in an activation query is 5 identifiers and unlimited string value columns
Rows
- The minimum number of rows is depends on the settings for Rounding / Redaction. This defaults to 100 but can be set as low as 25.
- The maximum number of rows in a Dataset is 5 billion (see Dataset limits for details)
Supported browsers
Our dev team tests our platform on the following browsers, which we recommend you use to ensure issues with the tool aren't browser related.
- Google Chrome
- Firefox
We recommend that you always use the current version of a browser. Most browsers provide an option for automatic updates.
Data in Dataset limits
Depending on which is greater, the maximum size Dataset you can upload to InfoSum Platform is limited by either:
- The total number of rows, or
- The total number of unique key values for a single key
Dataset with single value keys
For Datasets with single value keys, there will only ever be one value per row so the limit for total number of rows will always apply. This is because the total number of key values can never exceed the total number of rows. In the example below, the key values for the individual keys Email, Cookie or Mobile Advertising ID will never be more than the total number of rows.
Datasets with multi-value keys
For Datasets with multi-value keys, where a single row contains more than one key value per key, the unique key values limit applies as the row limit will never be reached. This is because the number of key values for a multi-value key will always exceed the number of rows. In the example below, the Dataset has a total of 4 rows, but the Email key has 7 unique key values because the Email column is a multi-value key. If, for example, the Platform limit for total rows or key values is 6, the Dataset would not upload even though the total number of rows is under the limit. The key values limit applies to each unique key column in the Dataset.
| Internal ID | First Name | Cookie | Mobile Advertising ID | |
| 1 | John | #email1,#email2 | cookie1 | maid1 |
| 2 | Dave | #email3,#email4 | cookie2 | maid2 |
| 3 | Jamie | #email5,#email6 | cookie3 | maid3 |
| 4 | Katy | #email7 | cookie4 | maid4 |