Learn how you can set up data extraction in four steps
You can set up the data extraction in two ways:
This instruction will help you to set up data extraction in four steps:
You can see all available accounts and their IDs on the left side of the screen and the list of selected accounts on the right. The number in the orange circle shows how many accounts you have chosen.
Also, you can sort them by ascending or descending date added and use the search field to find the necessary account by its name or ID.
The Date added column shows when each account was added to Improvado.
Recently added accounts are shown first by default. That allows you to find the necessary accounts faster.
When all the necessary accounts are selected, click the Continue button. This button is non-clickable while the selected accounts list is empty.
If the list contains more than ten items, pagination settings will appear at the bottom of this list. Using the checkbox in the list header, you can select all accounts on this page. To select more accounts, you can move between pages. Marked checkboxes are saved when moving.
To select more than 10 accounts for extraction, follow the steps from the image below:
This step is similar to the previous. You can see all available templates, their labels and types on the left side of the screen and the selected templates on the right. The number in the orange circle shows how many templates you have selected.
You can use type filter to see only global or custom templates and label filter to find the most popular extraction templates. Also, you can sort the data ascending or descending and use the search field to find the necessary template.
Suppose you know the fields you want to see in extracted data. In that case, you can find the relevant global and custom extraction templates by properties/dimensions Field Name from Improvado Data Dictionary without leaving the extraction flow using the Extraction Template filter.
The filter works according to the AND logic. It means that the result extraction templates include all selected fields:
Click on the Details to clarify the settings of a particular template. If you don’t have the necessary template, you can edit an existing one (only for custom templates) or click the Create a template button to a new one.
It is important to remember that you can not select all templates together. It depends on which global extraction template they are based on.
You can not select more than one template based on the same global extraction template. This restriction applies to both global and custom templates.
After selecting all the necessary templates, click the Continue button to move to the next step.
This button can be non-clickable in two cases:
Each account + extraction template pair will correspond to the extraction order. It means that there will be only one extraction order with one template and one account.
Let's say the total extraction orders number equals m*n where
If m*n ≤ 1000 - the Continue button is clickable.
If m*n > 1000 - the Continue button is disabled.
Now you need to configure each selected template. You will see the sequential number of the current template on the left side of the page.
You need to select the first date of the historical data interval. The maximum historical data depth varies due to the API specifics of different data sources. If you need historical data depth over the preset maximum value, it is necessary to raise a request via Improvado Service Desk. Our team will check if it is technically possible.
Note that you will be able to change it later by editing the extraction order configuration on the Settings tab.
Here you can set the frequency of data extraction by changing the scheduling settings and adding or deleting schedules.
One schedule is always created by default. You can add one or several more by clicking Add Schedule on the top right corner of this section. If this is not available, it means you have reached your limit. The contract determines the limit. To increase it, please get in touch with your Customer Success Manager.
Also, can delete the schedule by clicking the “trash bin” icon, but it is impossible to delete a schedule if it is the only one.
The schedule has three fields:
Now you can schedule data extraction daily, weekly (by selecting the day of the week), and monthly (by choosing a day of the month).
The first schedule will always have a default lookback window:
IMPORTANT: no lookback window for last day and last day (inc) extraction templates.
Previously the subsequent schedules had a Live lookback window. Now we’ve added the possibility to choose the max lookback window option.
IMPORTANT: if you have selected two or more global templates, the schedule settings of the first one will be applied to the following global templates, and then you can change them sequentially. This will not affect the custom templates settings.
Available dimensions and metrics are presented in lists similar to accounts and templates and work in the same manner.
Some dimensions and metrics are selected by default. You can not deselect them because they define the data table structure.
Note: You can also remove selected fields by clicking the Bin button in the Selected dimensions/metrics list.
After selecting all necessary items, click the Continue button. If there are any more extraction templates to be configured, they will appear on the screen one after another.
If all extraction templates are configured, let’s move to the last step and check the result.
This is the last step before the data extraction starts. Here you see the list of extraction orders you’ve configured on previous steps. It includes the following:
Check the resulting extraction orders carefully. If you notice that some order was added to this list by mistake, deselect it. Only selected extraction orders will be set up. Click the Continue button to finish the extraction configuration process.
A conflicted extraction orders list will appear after step 4 if you are trying to set up any existing extraction order. All existing orders will not be duplicated.
Two resolution actions are available:
Updated extraction orders and new ones will be displayed at the beginning of the extraction orders list. But unlike the new ones, the synch process will not be launched automatically for updated orders.