Documentation

How to start File Import flow (first ingestion)

‍

1. Click on the File Import tile. You can find it using the search or checking the Flat Data category.

2. File Importing flow will be opened after accessing the corresponding datasource.

Step 1 - Import

1. Click to select a file from your computer, or simply drag and drop your file to this area.

{%docs-informer info title="Note"%} A file must begin with column headers starting in column A. {%docs-informer-end%}

2. After picking the file a processing bar will show the upload progress. You can click on the “trash bin” icon to cancel the file upload.

3. After your file has been successfully uploaded and checked for security let’s move to the settings.
4. ~The first line of the file must be a column’s title. If additional information is provided before the column titles — it is necessary, use the Header rows to skip field to skip a certain number of rows to import data correctly.

4. Click on the Continue button.

Step 2 - Match

1. Set the Table name which will be used for loading data to your destination.

2. Select the columns you need to import. By default, all columns are selected.
3. Check the type. Each column in a data table can be assigned a text, number, or date type.
4. ~The date column is a unique date-key in the database and should be singular. Also, you have the flexibility to choose from a wide range of date formats for this column.
5. ~If you have column with numeric values that you don't want to include in your calculations, change the type from Number to Text.

{%docs-informer info title="Note"%} You can learn more about how to work with dates in Flat Data here. {%docs-informer-end%}

4. The skip rule allows you to exclude empty rows and rows with specific values in a selected column
5. ~Default to 'Do Not Skip': Ensures all data is initially included.
6. ~Multi-Select Options: Combine 'Skip: empty' and 'Skip: value' for targeted exclusions. Selecting 'Do Not Skip' disables other skip options.
7. ~Custom Rule addition: Add one custom rule; the form is disabled afterward to maintain focus
8. ~Custom Rule deletion:  Hover over and click on the red-highlighted basket icon next to the rule to exclude it.‍

‍Usage Note: the component is designed for straightforward value-based selections and does not support complex expressions like '<10'.

{%docs-informer info title="Note"%} System default account ID, account name, and date_yyyymmdd columns are automatically added by default. The 'id', 'metrics', 'account_id' reserved for internal usage. Please do not import columns with the same names to avoid data issues. {%docs-informer-end%}

5. Click on the Import N columns button to continue.

Step 3 - Preview

1. Check the structure of data that will be extracted.

2. Once you've reviewed the columns, click the Continue button to confirm settings and proceed with data extraction.

How upload more files with the same structure

1. Find the File Import on the Connections page.
2. Choose one of the Imported Files. Each element in the list corresponds to a Data Tabe with a structure set during the first setup.
3. Click to select a file from your computer, or simply drag&drop an additional file to this area.
4. A list of uploaded files below will be enriched with a new file.