Set up data quality assessment project

You can use a data quality assessment project to examine the quality of existing data.

You can do a data quality assessment, for example, if you:

• Have implemented a change in the Data Quality Studio configuration and want to make sure existing data is in line with this change.

• Have imported data without applying data quality policies.

• Want to periodically check the quality level of your data.

In a data quality assessment project, you can apply:

• All validation rules and duplicate check rules of a data quality policy.

• Specific validation rules or duplicate check rules of a data quality policy.

Steps

1. Go to Data quality studio > Quality assessment > Quality assessment projects.

2. Click New.

3. In the Name field, type a value.

4. In the Description field, type a value.

5. You can define a general data owner for the data quality assessment project.

   The general data owner can view and process the quality  assessment results for all companies.

   In the Data owner field, enter or select a value.

   Note

   To define a data owner, select a worker as set up in Human resources.

6. You can set up an email notification to inform the data quality assessment data owner each time the data quality assessment project has run. The notification includes a Microsoft Excel file with the assessment results. This way, the data owner receives prompt notifications and can easily review the results after each run.

   Select Yes in the Enable email field.

7. If you selected Yes in the Enable email field, define the email template for the email notification.

   In the Email template field, enter or select a value.

8. Sub-task: Set up Data Entry Workflow integration for quality assessment project.

   1. You can set up an integration to Data Entry Workflow.

      On a data quality assessment run, a record can fail the data quality assessment. As a data quality officer, you can review the records with an error or warning in the Quality assessment exceptions log. With the Data Entry Workflow integration, you can start a data entry workflow to edit a record that failed a data quality assessment.

      Expand the Workflow template setup section.

      Note

      You can only use the Data Entry Workflow integration if Data Entry Workflow is installed on the D365 F&SCM the environment.

   2. Define the data entry workflow template to be applied.

      Make sure the data entry workflow template contains the fields that are checked in the data quality assessment.

      In the Workflow template field, enter or select a value.

   3. Define the applicable data entry workflow document record.

      In the Workflow document record id field, enter or select a value.

      Note

      Based on the selected workflow document record, the related parent data source is filled in automatically.

   4. Define the applicable query.

      The query must contain the fields that are assessed by the data quality assessment project. Make sure the query contains the assessed fields that are part of and that are not part of the parent data source.

      In the Workflow template query field, enter or select a value.

      Note

      Set up the dynamic query to return unique records. To do so, in the dynamic query, the first defined table must be the main table. Use data entities for the next table records. For each of the data entity table records, define the applicable parent.

   5. You can automatically start a data entry workflow for records that fail the data quality assessment, based on criteria you define.

      Select Yes in the Auto-initiate workflow field.

      Note

      • You can only enable this field if you already selected a value in the Workflow template field.

      • If you remove the workflow template afterwards, the field automatically resets to No.

   6. Define when a data entry workflow is started automatically.

      In the Workflow trigger criteria field, select the desired option:

      • Errors only: A workflow is started only for records with a validation error.

      • Warnings only: A workflow is started only for records with a validation warning.

      • Both errors and warnings: A workflow is started for records with a validation error or a validation warning.

      Note

      This field is only available if you selected Yes in the Auto-initiate workflow field. The default value is Errors only.

   7. You can send a summary email when automatic workflows creation is finished. One email is sent per assessment run. The email is sent to the assignees of the first step of the workflow template, for the respective legal entity.

      Select Yes in the Email notification on auto-workflow field.

      Note

      • This field is only available if you selected Yes in the Auto-initiate workflow field.

      • If no workflow instances are created during the run, no email is sent.

   8. If you selected Yes in the Email notification on auto-workflow field, define the email template.

      In the Auto-workflow email template field, enter or select a value.

      Note

      The email template supports the tags %AssessmentProjectName% and %WorkflowInstanceCount%.

   9. Review the Latest run summary field to see the outcome of the most recent automated workflow creation. It shows, for example the number of workflows created, skipped, and failed.

      Note

      This field is read-only. It is automatically updated after each assessment run.

9. Sub-task: Define data quality policies to be applied.

   1. Expand the Data quality policy assignment section.

   2. Click Add.

   3. In the Data quality policy field, enter or select a value.

      Note

      • You can only select active data quality policies.

      • To apply all validation rules and duplicate check rules of the data quality policy, do not select specific rules. The Rules selection field shows the status 'All'. If you have selected specific rules, the Rules selection field shows the status 'Selective'.

   4. For a quality assessment project, you can apply specific validation rules of a data quality policy.

      On the Validation rules tab, click Add rules.

   5. On the dialog, in the list, select the desired validation rules.

   6. Click OK.

   7. For a quality assessment project, you can apply specific duplicate check rules of a data quality policy.

      Click the Duplicate check rules tab.

   8. Click Add rules.

   9. On the dialog, in the list, select the desired duplicate check rules.

   10. Click OK.

10. Sub-task: Define data owners for specific companies.

    1. You can define company-specific data owners for the data quality assessment project.

       A company-specific data owner can view and process only the quality  assessment results for the assigned company.

       Expand the Data owners section.

    2. Click Add.

    3. In the Data owners field, enter or select a value.

       Note

       To define a data owner, select a worker as set up in Human resources.

    4. In the Company field, enter or select a value.

    5. You can set up an email notification to inform a company-specific data owner each time the data quality assessment project has run. The notification includes a Microsoft Excel file with the assessment results for the company. This way, the company-specific data owner receives prompt notifications and can easily review the results after each run.

       Select the Enable email check box.

    6. If you selected Yes in the Enable email field for a company-specific data owner, define the email template for the email notification.

       In the Email template field, enter or select a value.

11. Close the page.