1. Data Management
  2. Data Quality Studio
  3. Flows

Set up duplicate check rules
Activity Flow

Use a duplicate check rule to check if the data doesn't already exist in D365 F&SCM.

Before you can set up a duplicate check rule, set up the duplicate check to be applied.

You can apply these types of duplicate checks:

  • Basic matching: Checks which combination of table fields has duplicate values. So, the combination of field values must be unique in the table.
  • Fuzzy matching: Checks for duplicates applying fuzzy logic. A fuzzy duplicate check compares values from several fields. Based on the comparison, a duplicate score is calculated. You can start a duplicate check rule of type 'fuzzy matching' only manually. Therefore, define from which forms you can start duplicate checks of type 'Fuzzy matching'.

Data quality administrator Data quality administrator The data quality administrator (DQSDataQualityAdministrator) can set up and maintain: Data quality policies Data quality studio parameters Data quality studio general setup Start Start Duplicate check  exists? Duplicate check  exists? Set up duplicate check

Set up duplicate check

You can use duplicate check rules to check if data doesn't already exist in D365 F&SCM.

Before you can set up a duplicate check rule, set up the duplicate check to be applied.

You can apply these types of duplicate checks:

  • Basic matching: Checks which combination of table fields has duplicate values. So, the combination of field values must be unique in the table.
  • Fuzzy matching: Checks for duplicates applying fuzzy logic. A fuzzy duplicate check compares values from several fields. Based on the comparison, a duplicate score is calculated.

 Set up duplicate check rule Set up duplicate check rule Use a duplicate check rule to check if the data doesn't already exist in D365 F&SCM. Before you can set up a duplicate check rule, set up the duplicate check to be applied. You can apply these types of duplicate checks: Basic matching: Checks which combination of table fields has duplicate values. So, the combination of field values must be unique in the table. Fuzzy matching: Checks for duplicates applying fuzzy logic. A fuzzy duplicate check compares values from several fields. Based on the comparison, a duplicate score is calculated. Procedure 1. Click Data quality management. 2. On the Data quality policies tab, in the list, click the link of the desired data quality policy. 3. Click the Duplicate check rules tab. Note: If you want to edit another data quality policy version than the currently shown version, first select the desired version. To do so, on the Action Pane, on the Version tab, click Versions. On the dialog, select the desired version and click OK. 4. Click Add. 5. In the Duplicate check field, enter or select a duplicate check of type Basic matching. 6. In the Outcome field, select an option. 7. Close the page. Does the duplicate  check rule apply  to specific data? Does the duplicate  check rule apply  to specific data? Set up duplicate check rule conditions

Set up duplicate check rule conditions

For each duplicate check rule, you can set up conditions. The duplicate check rule is only applied if the conditions are met.

To define a duplicate check rule condition, you use a query. The duplicate check rule is applied only to the records that are found by the query.
You can use these types of queries:
  • Inquiry: Use the standard D365 F&SCM Inquiry (SysQueryForm) page to define the records to which the duplicate check rule applies. The inquiry only queries the table as defined for the duplicate check rule.
  • Dynamic query: Use a dynamic query to define the records to which the duplicate check rule applies. Before you can set up a condition with a dynamic query, set up the dynamic query to be applied. You can use a dynamic query, for example, to query other tables than the duplicate check rule table, to define table relations, and to have only one record returned.
 

 Have you set up a  duplicate check of  type Fuzzy matching? Have you set up a  duplicate check of  type Fuzzy matching? Define to which forms fuzzy duplicate check rules apply Define to which forms fuzzy duplicate check rules apply You can start a duplicate check rule of type 'Fuzzy matching' manually or using a data quality assessment project.To indicate the forms from which you can manually start a duplicate check rule of type 'Fuzzy matching', set up the dynamic menu form setup.To each form in the dynamic menu form setup, these buttons are added:Check for duplicates: Starts the first found active Fuzzy matching duplicate check that:Applies to the main table of the form.Is used in a duplicate check rule of an active data quality policy.History: Opens the duplicate check history of the selected record.Button styleIn the dynamic form setup, use the Style to define where and how the 'Check for duplicates' button and the 'History' button are shown on the form:New action pane tab: To the Action Pane, the 'Data quality' tab is added as the first tab. This tab shows the 'Duplicate check' button group with the buttons.New button group: The buttons are shown on the task bar, right to the existing buttons. Existing action pane tab: To an existing Action Pane tab, the 'Duplicate check' button group is added. This button group shows the buttons. In this case, you must select the Action Pane tab to which the 'Duplicate check' button group must be added. You can indicate next to which existing button group the 'Duplicate check' button group is added. If you don't do so, the 'Duplicate check' button group is added as the first button group of the Action Pane tab.PrerequisitesOn a form with dynamic menu form setup, you can start a duplicate check rule of type 'Fuzzy matching' only if:The duplicate check rule is part of an active data quality policy.The duplicate check rule uses an active duplicate check of type 'Fuzzy matching' that applies to the main table of the form. The table to which the duplicate check applies is defined in the duplicate check header, in the Table name field. Procedure 1. Go to Data quality studio > Setup > Dynamic menu form setup. 2. Click New. 3. In the Form name field, enter or select a value. 4. In the Style field, select an option. 5. In the Action pane tab field, enter or select a value. 6. In the After button group field, enter or select a value. 7. Close the page. End End No Yes Yes No Yes No

Activities

Name Responsible Description

Set up duplicate check

Data quality administrator

You can use duplicate check rules to check if data doesn't already exist in D365 F&SCM.

Before you can set up a duplicate check rule, set up the duplicate check to be applied.

You can apply these types of duplicate checks:

  • Basic matching: Checks which combination of table fields has duplicate values. So, the combination of field values must be unique in the table.
  • Fuzzy matching: Checks for duplicates applying fuzzy logic. A fuzzy duplicate check compares values from several fields. Based on the comparison, a duplicate score is calculated.

Set up duplicate check rule

Data quality administrator

Use a duplicate check rule to check if the data doesn't already exist in D365 F&SCM.

Before you can set up a duplicate check rule, set up the duplicate check to be applied.

You can apply these types of duplicate checks:

  • Basic matching: Checks which combination of table fields has duplicate values. So, the combination of field values must be unique in the table.
  • Fuzzy matching: Checks for duplicates applying fuzzy logic. A fuzzy duplicate check compares values from several fields. Based on the comparison, a duplicate score is calculated.

Set up duplicate check rule conditions

Data quality administrator

For each duplicate check rule, you can set up conditions. The duplicate check rule is only applied if the conditions are met.

To define a duplicate check rule condition, you use a query. The duplicate check rule is applied only to the records that are found by the query.
You can use these types of queries:
  • Inquiry: Use the standard D365 F&SCM Inquiry (SysQueryForm) page to define the records to which the duplicate check rule applies. The inquiry only queries the table as defined for the duplicate check rule.
  • Dynamic query: Use a dynamic query to define the records to which the duplicate check rule applies. Before you can set up a condition with a dynamic query, set up the dynamic query to be applied. You can use a dynamic query, for example, to query other tables than the duplicate check rule table, to define table relations, and to have only one record returned.
 

Define to which forms fuzzy duplicate check rules apply

Data quality administrator

You can start a duplicate check rule of type 'Fuzzy matching' manually or using a data quality assessment project.

To indicate the forms from which you can manually start a duplicate check rule of type 'Fuzzy matching', set up the dynamic menu form setup.

To each form in the dynamic menu form setup, these buttons are added:

  • Check for duplicates: Starts the first found active Fuzzy matching duplicate check that:
    • Applies to the main table of the form.
    • Is used in a duplicate check rule of an active data quality policy.
  • History: Opens the duplicate check history of the selected record.

Button style

In the dynamic form setup, use the Style to define where and how the 'Check for duplicates' button and the 'History' button are shown on the form:

  • New action pane tab: To the Action Pane, the 'Data quality' tab is added as the first tab. This tab shows the 'Duplicate check' button group with the buttons.
  • New button group: The buttons are shown on the task bar, right to the existing buttons. 
  • Existing action pane tab: To an existing Action Pane tab, the 'Duplicate check' button group is added. This button group shows the buttons. In this case, you must select the Action Pane tab to which the 'Duplicate check' button group must be added. You can indicate next to which existing button group the 'Duplicate check' button group is added. If you don't do so, the 'Duplicate check' button group is added as the first button group of the Action Pane tab.

Prerequisites

On a form with dynamic menu form setup, you can start a duplicate check rule of type 'Fuzzy matching' only if:

  • The duplicate check rule is part of an active data quality policy.
  • The duplicate check rule uses an active duplicate check of type 'Fuzzy matching' that applies to the main table of the form. The table to which the duplicate check applies is defined in the duplicate check header, in the Table name field.

Activities

Name Responsible Description

Set up duplicate check

Data quality administrator

You can use duplicate check rules to check if data doesn't already exist in D365 F&SCM.

Before you can set up a duplicate check rule, set up the duplicate check to be applied.

You can apply these types of duplicate checks:

  • Basic matching: Checks which combination of table fields has duplicate values. So, the combination of field values must be unique in the table.
  • Fuzzy matching: Checks for duplicates applying fuzzy logic. A fuzzy duplicate check compares values from several fields. Based on the comparison, a duplicate score is calculated.

Set up duplicate check rule

Data quality administrator

Use a duplicate check rule to check if the data doesn't already exist in D365 F&SCM.

Before you can set up a duplicate check rule, set up the duplicate check to be applied.

You can apply these types of duplicate checks:

  • Basic matching: Checks which combination of table fields has duplicate values. So, the combination of field values must be unique in the table.
  • Fuzzy matching: Checks for duplicates applying fuzzy logic. A fuzzy duplicate check compares values from several fields. Based on the comparison, a duplicate score is calculated.

Set up duplicate check rule conditions

Data quality administrator

For each duplicate check rule, you can set up conditions. The duplicate check rule is only applied if the conditions are met.

To define a duplicate check rule condition, you use a query. The duplicate check rule is applied only to the records that are found by the query.
You can use these types of queries:
  • Inquiry: Use the standard D365 F&SCM Inquiry (SysQueryForm) page to define the records to which the duplicate check rule applies. The inquiry only queries the table as defined for the duplicate check rule.
  • Dynamic query: Use a dynamic query to define the records to which the duplicate check rule applies. Before you can set up a condition with a dynamic query, set up the dynamic query to be applied. You can use a dynamic query, for example, to query other tables than the duplicate check rule table, to define table relations, and to have only one record returned.
 

Define to which forms fuzzy duplicate check rules apply

Data quality administrator

You can start a duplicate check rule of type 'Fuzzy matching' manually or using a data quality assessment project.

To indicate the forms from which you can manually start a duplicate check rule of type 'Fuzzy matching', set up the dynamic menu form setup.

To each form in the dynamic menu form setup, these buttons are added:

  • Check for duplicates: Starts the first found active Fuzzy matching duplicate check that:
    • Applies to the main table of the form.
    • Is used in a duplicate check rule of an active data quality policy.
  • History: Opens the duplicate check history of the selected record.

Button style

In the dynamic form setup, use the Style to define where and how the 'Check for duplicates' button and the 'History' button are shown on the form:

  • New action pane tab: To the Action Pane, the 'Data quality' tab is added as the first tab. This tab shows the 'Duplicate check' button group with the buttons.
  • New button group: The buttons are shown on the task bar, right to the existing buttons. 
  • Existing action pane tab: To an existing Action Pane tab, the 'Duplicate check' button group is added. This button group shows the buttons. In this case, you must select the Action Pane tab to which the 'Duplicate check' button group must be added. You can indicate next to which existing button group the 'Duplicate check' button group is added. If you don't do so, the 'Duplicate check' button group is added as the first button group of the Action Pane tab.

Prerequisites

On a form with dynamic menu form setup, you can start a duplicate check rule of type 'Fuzzy matching' only if:

  • The duplicate check rule is part of an active data quality policy.
  • The duplicate check rule uses an active duplicate check of type 'Fuzzy matching' that applies to the main table of the form. The table to which the duplicate check applies is defined in the duplicate check header, in the Table name field.
Related to Notes

Apply data quality rules on entering or updating a record

 		 

Apply data quality rules on data import with Connectivity studio

 		 

Set up duplicate check rules

 		 

Provide feedback