1. Data Management
  2. Data Modeling Studio
  3. Activities

Set up data export parameters
Application task

Set up the parameters that are applied:

  • To scheduling an export batch job.
  • During the export of data, like timeout settings.
  • To creation of data models: Schema.


Standard procedure

1. Go to Data modeling studio > Data modeling studio > Parameters.
2. Click the Data export tab.
3. Sub-task: For DMF parameters, refer to Data management framework documentation.
4. Sub-task: Set scheduling parameters.
  4.1 You can define a default recurrence in hours. On creation of a data model, this recurrence is used to set the default recurrence of the data model. If you schedule an export batch job for the data model, the data model default recurrence is used to set the default batch job recurrence.
  In the Recurrence (in hours) field, enter a number.
 

Note: If the default recurrence parameter is changed after the creation of a data model, the default data model recurrence is not changed.
  4.2 On a data set, you can set the Data selection field to Timestamp. If so, on export, only the records are exported that are created or updated since the latest export date/time.
You can define a window size in hours to include records in the export with a created or updated date/time a number of hours before the latest export date/time.
Example:
- Window size is 2.
- Latest export date/time was yesterday at 12:00:00 o'clock.
- Today, the next export is run at same time.
In today's export, records are included with a created or updated date/time from yesterday 10:00:00 o'clock.
  In the Window size field, enter a number.
  4.3 You can define the schema that is used to set the default schema for a data model. On deploy of a data model, the schema is applied to create the tables in the target database.
  In the Schema field, type a value.
 

Note: In an ETL (Extract, Transform, Load) process, the best practice schema for unprocessed data is 'RAW'.
  4.4 The export of data from D365 FO to the target database is done by the Bulk copy (SQLBulkCopy) function.
You can define a timeout to limit the time of an export.
If you define an export timeout, the data export is stopped when the defined number of seconds has passed.
If an export is stopped by a timeout, the data export is rolled back and the entity export status is set to Error.
  In the Export timeout (in seconds) field, enter a number.
 

Note: If the timeout is 0 seconds, no timeout is applied.
  4.5 On export, several SQL operations can be executed on both the D365 FO database and the target database. These SQL operations are triggered by the Execute command (ExecuteCommand) function. An operation can be, for example, a count on the Target database or a select on the D365 FO database.
You can define a timeout to limit the execute command SQL operation execution time.
If you define a command timeout, the operations execution is stopped when the defined number of seconds has passed.
If an operation is stopped by a timeout, no response is returned.
  In the Command timeout (in seconds) field, enter a number.
 

Note: If the timeout is 0 seconds, no timeout is applied.
  4.6 On deploy, you can apply transformations.
You can define a timeout to limit the time of a transformation execution. The timeout is applied to each transformation separately.
If you define a timeout, a deploy transformation execution is stopped when the defined number of seconds has passed.
When a transformation is stopped by a timeout, the transformation is rolled back and no transformation is done.
  In the Transformation timeout (in seconds) field, enter a number.
 

Note: If the timeout is 0 seconds, no timeout is applied.
  4.7 On data export, you can apply pre- and post-export transformations.
You can define a timeout to limit the time of a transformation execution. The timeout is applied to each transformation separately.
If you define a processing timeout, an export transformation execution is stopped when the defined number of seconds has passed.
When a transformation is stopped by a timeout, the transformation is rolled back and no transformation is done.
  In the Post-processing timeout (in seconds) field, enter a number.
 

Note: If the timeout is 0 seconds, no timeout is applied.
Related to Notes

Set up parameters

 		 

Provide feedback