Product Models

Description

Improvado Product Models is a set of tables that detail key objects within the Improvado platform and dataflow activity. These tables reflect information on extracts, loads, data tables, and statuses. Tables can be accessed via the user interface or exported to a desired destination.

List of Data Models

Name	Description	Update frequency
src_improvado_currency_exchange_rates	View with daily currency exchange rates	daily
src_improvado_order_runs_billing	Data mart of extraction order’s runs within workspace with billed rows amount. Every row is an unique event of particular order execution. Served as append-only event log. Source of the Billing Dashboard	~ 9 hours
src_improvado_datatables	View of datatables created within workspace. Each row is last state of particular datatable’s attributes	~ 9 hours
src_improvado_datasource_accounts	View of datasource accounts connected within workspace. Each row is last state of particular datasource account’s attributes	~ realtime
src_improvado_dataflow_run_events (click to download a XLSX with columns description)	Data mart of ETL dataflow runs within workspace. Served as append-only event log. Source of the Dataflow Dashboard Every row is an unique event of particular order execution attributed to ETL dataflow. Basically this data is used for custom ETL analytics. For example, such query might be used to determine current status of all dataflows. See below.	< 5 minutes
src_improvado_datasource_fields	View of all available within workspace datasource fields, including already used in extraction orders. Each row is last state of particular datasource field’s attributes.	~ 9 hours

src_improvado_dataflow_run_events


select
    dataflow_id,
    max(dataflow_run_started_time)                                    as last_run_start_timestamp,
    max(dataflow_run_event_time)                                      as last_timestamp,
    argMax(dataflow_run_event_name, dataflow_run_event_time)          as last_event_name,
    maxIf(dataflow_run_event_time, is_dataflow_run_complete)          as last_completion_timestamp,
    argMax(dataflow_run_duration_seconds, dataflow_run_event_time)    as last_dataflow_run_duration_seconds
from
    src_improvado_dataflow_run_events
group by
    dataflow_id