Dataflow Dashboard

Learn how to enhance visibility, troubleshooting, and performance monitoring of your log data.


The Dataflow Dashboard allows to seamlessly aggregates and showcases log data in both near real-time and historical perspectives, delivering key insights in a visual format across multiple Improvado products.

Let's introduce the following definitions:

  • Order is an entity that describes all settings for an extraction, transformation, or load process.
  • ~An extraction order is responsible for retrieving data from various sources such as API providers, flat files, and others. It operates based on specific parameters including report type, account details, and scheduling settings.
  • ~A load order is directly data-driven by its corresponding extraction order. Once data is successfully extracted, the load order is triggered to ingest this extracted data into the designated storage.
  • Dataflow is a sequential chain of orders initiated from data extraction. Depending on your requirements, this order sequence may extend through various processes such as ETL (Extract, Transform, Load), ELT (Extract, Load, Transform), EL (Extract, Load).

The primary objective of dataflow is to facilitate seamless data delivery from the starting point (data source) to the ending point, which is tailored to the user’s specific needs. This ending point could either be your connected Destination or the Improvado Storage.

User flow in UI

To start using this feature click the Dataflow Dashboard item in the menu on the left side of the screen.

Upon loading the Dataflow Dashboard page, you'll encounter the main page showcasing two primary sections:

  • Charts
  • Filters

Let's look at each of them in more detail.


The time zone and Estimated Time of Arrival (ETA) are established by your Customer Success Manager (CSM). The data displayed in the dashboard is presented in accordance with this designated time zone. The Delivery Rate and Data delivery tracking metrics are calculated based on these specified values.

If you have any concerns or questions regarding this information, please contact your dedicated CSM for further assistance.

Scorecards with trends:

  • Delivery rate %: Shows the percentage of orders that have been delivered to customers in time out of all successful dataflow runs. (Dataflow)
  • Success rate %: Displays the percentage of completed orders out of the total initiated. (Dataflow)
  • Manual sync %: Reveals the percentage of orders manually synchronized by customers out of the total initiated. (Orders)
{%docs-informer info%} The Scorecards with trends always reflects data for today, regardless of any time range filter you may set. This means that even if you've applied a specific time range filter, the percentage values will remain based on today's data. {%docs-informer-end%}


  • Started: Displays the total number of orders that have been initiated or started. (Dataflow)
  • In progress: Reflects the total number of orders that are actively being processed. (Dataflow)
  • Success: Indicates the exact number of orders that are completed. (Dataflow)
  • Failed: Specifies the exact count of orders that have encountered failure. (Dataflow)
  • Manual sync: Shows the total number of orders that have been synced manually by the customer. (Orders)
  • Duration avg: Represents the average duration of order fulfillment. (Dataflow)

Dataflow charts:

  1. Top 10 average dataflow duration by data table: Demonstrates 10 dataflows with the highest average duration across various data tables.
  1. Top 10 average delivery ETA overdue by data table: Displays the top 10 tables with the highest average of overdue deliveries with estimated arrival times.
  1. Data delivery tracking: This table summarises the key data delivery metrics. It enables you to identify the most problematic dataflows and consider the recommended scheduling options.
{%docs-informer warning title="Important"%} The values provided in the Top 10 average delivery ETA overdue data table and the Data delivery tracking charts may vary. The Top 10 average delivery ETA overdue table specifically reflects data on delayed orders, while the Data delivery tracking charts encompass all orders, including those that were delivered on time. {%docs-informer-end%}

Orders charts:

  1. Summary table: This table represents key metrics for order performance across various data sources for the specified period.
  1. Failed and success by data source: This bubble chart compares the number of successes and failures across data sources.
  1. Top 5 failures by data source / day: Displays the 5 data sources with the most failures for every day of the specified period.
  1. Top 10 Failures by data source / time range: Illustrates the top 10 data sources with the most failures for the specified period.
  1. Failures summary table: Represents key metrics about each data delivery failure, helping identify, analyze, and troubleshoot issues in your data pipelines more effectively.

{%docs-informer info%} Chart and table elements are interactive, you can click on them to filter certain data. {%docs-informer-end%}


To refine the data presented in the Dataflow Dashboard, the platform offers a variety of filters that allow you to tailor the information to your specific needs.You can filter your data by:

  • Workspace (Select a specific workspace to view its log data.)
  • Time range (Choose a pre-set date range to focus your log data analysis, note that the smallest intervals, like a minute to an hour, are not supported.)
  • Product (Filter the orders by dataflow process product.)
  • Data source (Filter the orders by specific data sources to see usage from particular platforms.)
  • Data table (Narrow down the view to specific data tables for targeted analysis.)
  • Account name (Focus on orders related to a particular account within your workspace.)

After choosing the necessary parameters in filters you can apply them by clicking on the Apply filters button, it will automatically refresh your overview page. If you want to undo all the applied filters, click on the Clear all button.

{%docs-informer info%} If you have any issues, please contact your CSM. {%docs-informer-end%}

Frequently asked questions

No items found.
No items found.
No items found.
☶ On this page


Improvado team is always happy to help with any other questions you might have! Send us an email.

Contact your Customer Success Manager or raise a request in Improvado Service Desk.