Documentation

How to work with dates when uploading Flat Data files

Updated on

Jul 31, 2024

The Date field is a unique date-key in the database and must be singular. The Date field is needed if you want to use update logic that utilizes date-key (i.e. Incremental update logic).

To optimize data processing and ensure alignment with our internal systems, Improvado platform prioritizes fields named Date for identifying unique date-key. To ensure clarity and avoid any unintentional use of existing Date fields, we recommend renaming them to a more specific name within your spreadsheet context.

  • Incremental (with date-key). Records get modified, and the old data is saved. Already existing rows get determined based on the set of dimensions in a Flat Data file and only rows that were changed are updated. Updated rows are not counted for your row count usage.
  • Snapshot (without date-key). All data is overwritten each time. We will automatically add an internal date-key field called date for any files missing a date-key field with today's date.

If your files have empty values in the Date key field, you’ll need to set up a Skip rule for this field. Otherwise, you’ll receive an error during extraction.

Click to open in full screen 👀

We offer a wide range of date formats for the Date field, allowing you to choose the one that best matches your existing setup.

You can also see the full list of supported date formats:

Note: The date format you select from the dropdown indicates the date format in that field of your spreadsheet and helps us correctly parse dates in that field. But it is not the date format that will be stored in Improvado.

If the date format in your Flat Data files is missing from the list, you can create a new request using the Improvado Service Desk.

Our system automatically adds the following default fields:

  • date_yyyymmdd

Please avoid importing fields with these names to prevent data conflicts.

No items found.
Check out troubleshooting guides for
How to work with dates when uploading Flat Data files
here:
    No items found.
    Related articles
    No items found.
    No items found.

    Questions?

    Improvado team is always happy to help with any other questions you might have! Send us an email.

    Contact your Customer Success Manager or raise a request in Improvado Service Desk.