Documentation

FTP

Updated on

May 2, 2024

Note: FTP is currently supported only as a Destination. This guide doesn’t cover the DataPrep setup for FTP.

You can learn how to extract data from SFTP data source here.

Description

FTP is a digital storage facility designed for securely housing and managing files through the File Transfer Protocol.

Schema information

Setup guide

Follow our setup guide to connect FTP to Improvado.

Complete configuration

On the FTP connection page, fill in the following fields:

  1. Enter a name for your Destination connection in the Title.
  2. Enter the Host.
  3. Enter the Port.
  4. Enter the User Name.
  5. Enter the Password.
  6. Enter the Folder. {%dropdown-button name="folder"%}

{%dropdown-body name="folder"%}

Possible parameters:

```/data_source/data_table_title/report_type/YYYY/MM/DD/timestamp```

  • ```data_source``` is a data provider, integration, connector
  • ```data_table_title``` is an object that contains all extraction orders with the same granularity (dimensional schema)
  • ```report_type``` is a set of such fields as metrics, properties, dimensions, etc.
  • ```timestamp``` is the date and time when data load started

If you use ```/YYYY/MM/DD settings```, the data will be added to folders daily. Each new record will not delete the previous one, even for data that contains no date.

Note: A forward slash ( / ) means that you need to enter the root path.

{%dropdown-end%}

  1. Select the necessary File format option from the dropdown. {%dropdown-button name="file-format"%}

{%dropdown-body name="file-format"%}

Possible formats:

  • csv
  • csv+gzip
  • json
  • json+gzip
  • parquet
  • avro

{%dropdown-end%}

  1. Enter the Filename. {%dropdown-button name="filename"%}

{%dropdown-body name="filename"%}

Possible parameters:

```filename-YYYY-MM-DD```

  • ```filename``` is the same as destination table name

Note: you cannot use ```DD``` for partition by month

  • ```filename-YYYY-MM-DD``` – for partition by day
  • ```filename-YYYY-MM``` – for partition by month

Also, you can use “_” instead of “-” or do not use any symbols at all, for example:

  • ```filenameYYYY-MM-DD```
  • ```filenameYYYYMMDD```

{%dropdown-end%}

  1. Select the necessary Separator option from the dropdown. {%dropdown-button name="separator"%}

{%dropdown-body name="separator"%}

Possible delimiters that can separate data in your file:

  • comma
  • semicolon
  • tab

{%dropdown-end%}

  1. Select the necessary Partition by option from the dropdown. {%dropdown-button name="partition-by"%}

{%dropdown-body name="partition-by"%}

Possible ways of splitting data:

  • Day
  • Month

{%dropdown-end%}

  1. Select the necessary Encryption option from the dropdown. {%dropdown-button name="encryption"%}

{%dropdown-body name="encryption"%}

Possible parameters:

  • Require explicit FTP over TLS (FTPS)
  • Explicit FTP over TLS if available (FTPS)
  • Plain FTP (insecure)

{%dropdown-end%}

  1. Select the necessary Use static IP option from the dropdown. {%dropdown-button name="use-static-ip"%}

{%dropdown-body name="use-static-ip"%}

Select Yes for Use static IP option if you allow Improvado to connect your database by the static IPs mentioned on the Destination connection page.

Select No if you have permitted access to your database from any IP. In this case, Improvado will connect your database using dynamic IPs not listed on the Destination connection page.

{%dropdown-end%}

Settings

No items found.

Troubleshooting

Troubleshooting guides

Check out troubleshooting guides for
FTP
here:

Limits

Frequently asked questions

No items found.
☶ On this page
Description
Related articles
No items found.
No items found.

Questions?

Improvado team is always happy to help with any other questions you might have! Send us an email.

Contact your Customer Success Manager or raise a request in Improvado Service Desk.