Documentation

To see the extraction orders configuration, you need to click on the order name in the extraction orders list.

Page header

The page header shows the extraction order name and status.

On the top right corner of this page, you’ll see Run Extraction button and a button for starting/pausing data extraction for an Extraction Order depending on its status.

Run Extraction button‍

Click this button to run the Extraction order for the selected date range.

‍

Overview tab

Here you see one line from the data tables list and the data structure preview.

Data table info

It contains brief information precisely about the data table to which the current extraction order refers:

• Data table name
• Data source
• Extraction orders number and status

The last column shows how many extraction orders relate to this table by granularity and the number of orders for each of these three statuses.

If there is no extraction orders in a certain status, then this status is not shown.

Hover over each status to see a tooltip:

• how many extraction orders were successfully loaded
• how many extraction orders are currently paused
• how many extraction orders have errors

IMPORTANT: A throbber (loading icon) means that at least one extraction order with the syncing status relates to this data table.

Hover over the loading icon to see how many extraction orders are currently syncing.

If all the extraction orders related to the data table have the syncing status you will see the total number of orders and zero on a gray background.

Data structure preview

Data structure preview is displayed if data has already been extracted.

IMPORTANT: Metrics (CPC, CPM, CPA, etc.) calculated as a ratio of dynamic values will not be pushed to the destination or shown in your BI tools (PowerBI, Tableau, etc.) since there is no use in calculating such metrics in advance and storing them. These metrics will be available only in Improvado widgets.

Let's take CPC as an example. Cost per click for a period is calculated by dividing the overall cost of your ads by the number of clicks your ads received.

CPC = total_cost / number_of_clicks

Let's calculate CPC using the values given in the table above:

CPC = $1288.3 / 64 = $20.13

Avg.CPC = $21.84

As you see, CPC for a week is not equal to the CPCs for the same seven days. You will also get an inaccurate result if you use the average value.

Settings tab

This tab includes the same settings blocks you used when creating this extraction order. The set of parameters depends on the selected data source and extraction template.

Now historical data settings are available here!

To refresh (backfill) the historical data you need to:

• change the first date of the required interval in this field
• and click the Update button to save changes.

The maximum historical data depth varies due to the API specifics of different data sources. If customer needs historical data depth over the preset maximum value, it is necessary to raise a request via Improvado Service Desk. Our team will check if it is technically possible.

Scheduling Settings

Here you can set the frequency of data extraction by changing the scheduling settings and adding or deleting schedules.

You can add one or several more by clicking the Add Schedule on the top right corner of this section.

If it is not available, it means you have reached your limit that is determined by your contract. To increase it, please get in touch with your Customer Success Manager.

Also, can delete the schedule by clicking the “trash bin” icon, but it is impossible to delete a schedule if it is the only one.

The schedule settings include three main fields, the additional fields depend on the chosen extraction period:

• extraction period allows you to set how often Improvado attempt to load your data to Improvado database.
• day of week/month determines the specific day of the week/month when the extraction begins.
• extraction time determines the exact time for the Improvado extraction schedule.
• extraction time zone determines the time zone for this extraction schedule.
• lookback window is the period before data extraction, for which data is extracted regularly.

Extraction period

Now you have the option to schedule data extractions on an hourly basis (every 4, 6, 8, or 12 hours), as well as daily, weekly (by selecting a specific day of the week), and monthly (by choosing a particular day of the month).
If you choose the Hourly extraction period, start now and start at set time options will appear:

Start Now Option:

• This option is designed for immediate data extraction. As soon as you select 'Start Now,' the extraction process will commence using the current time as its starting point.
• This is particularly useful for obtaining real-time data, conducting immediate analyses, or when working with time-sensitive information. It ensures that you have the most current data without any delay.

Start at Set Time Option:

• With this option, you can schedule the extraction to begin at a specific time of your choosing. This is ideal for planning extractions to align with specific business processes or reporting schedules.
• You can set the extraction to start at a time that ensures data is fresh and relevant for your daily operations, such as the beginning of your workday, or just before important meetings or decision-making processes.

After choosing either of these options, the system will automatically calculate the timing for the next extraction based on your initial choice.

Note:  Hourly schedule is available by request only. Please contact your Customer Success Manager for more details.  

Lookback window

The first schedule always has a default lookback window (you can not change it):

• in days for daily extraction templates
• in weeks for weekly extraction templates
• in months for monthly extraction templates

IMPORTANT: No lookback window for last day and last day (inc) extraction templates.

Previously the subsequent schedules had a Live lookback window. Now we’ve added the possibility to choose the max lookback window option.

Dimensions/metrics list

Available dimensions and metrics are presented the same way as before: all available are on the left, all selected on the right. The “locker” icon shows those dimensions, but also, some metrics are selected by default, and you can not deselect them because they define the data table structure.

If you need to update your extraction order, it is essential to remember the following:

• Updating metrics/dimensions for the extraction order will not automatically start data re-loading.
• Updated extraction order will not generate a new data table, but it will update the data that will be loaded into the existing table.
• To see the changes immediately, you can start data synchronization (click “Sync Data Now” action from the list of extraction orders); otherwise, you need to wait for the next scheduled data extraction.
• After your changes are applied, data will be loaded to newly chosen fields and stop populating to the deselected ones.