Documentation

How to start File Import flow (first ingestion)

‍

1. Click on the File Import tile. You can find it using the search or checking the Flat Data category.

2. File Importing flow will be opened after accessing the corresponding datasource.

Step 1. Import

1. Click to select a file from your computer, or simply drag and drop your file to this area.

{%docs-informer info title="Note"%}

• Supported file formats: CSV, TSV, XLS, XLSX, AVRO, ZIP, GZIP
• Maximum size: 10 GB
• A file must begin with column headers starting in column A. If additional information is provided before — it is necessary, use the Header rows to skip field to skip a certain number of rows to import data correctly.

{%docs-informer-end%}

2. After picking the file a processing bar will show the upload progress. You can click on the “trash bin” icon to cancel the file upload.
3. After your file has been successfully uploaded and checked for security let’s move to the settings.
4. Click on the Continue button.

Step 2. Match

1. Set the Table name which will be used for loading data to your destination.

2. Select the fields you need to import. By default, all fields are selected.
3. Check the type. Each field in a data table can be assigned a text, number, or date type.
4. ~The date field is a unique date-key in the database and should be singular. Also, you have the flexibility to choose from a wide range of date formats for this field.
5. ~If you have fields with numeric values that you don't want to include in your calculations, change the type from Number to Text.

{%docs-informer info title="Note"%} You can learn more about how to work with dates in Flat Data here. {%docs-informer-end%}

4. The skip rule allows you to exclude empty rows and rows with specific values in selected fields
5. ~Default to 'Do Not Skip': Ensures all data is initially included.
6. ~Multi-Select Options: Combine 'Skip: empty' and 'Skip: value' for targeted exclusions. Selecting 'Do Not Skip' disables other skip options.
7. ~Custom Rule addition: Add one custom rule; the form is disabled afterward to maintain focus
8. ~Custom Rule deletion:  Hover over and click on the red-highlighted basket icon next to the rule to exclude it.‍

‍Usage Note: the component is designed for straightforward value-based selections and does not support complex expressions like '<10'.

{%docs-informer info title="Note"%} System default account ID, account name, and date_yyyymmdd fields are automatically added by default. The 'id', 'metrics', 'account_id' reserved for internal usage. Please do not import fields with the same titles to avoid data issues. {%docs-informer-end%}

5. Click on the Import N fields button to continue.

Step 3. Preview

1. Check the structure of data that will be extracted.

2. Once you've reviewed the fields, click the Continue button to confirm settings and proceed with data extraction.

How upload more files with the same structure

1. Find the File Import on the Connections page.
2. Choose one of the Imported Files. Each element in the list corresponds to a Data Tabe with a structure set during the first setup.
3. Click to select a file from your computer, or simply drag&drop an additional file to this area.
4. A list of uploaded files below will be enriched with a new file.