Avoiding Duplicates in Dynamics

   Words by Anonymous

   on 16/04/2018 09:30:00

When we look at Data Management we have increasingly powerful tools with Machine Learning and connections to Online Services such as LinkedIn - however our end users are ultimately still human, and in the words of Alexander Pope “To err is human”, in which user error can result in duplicate records. 

Similarly 3rd Party Integrations with external sources/applications, logic bugs and other anomalies can also lead to some duplication of data.

To combat this Dynamics CRM gives us a handy tool in Duplicate Detection functionality under Data Management.

We can enable and start using this functionality by navigating to Settings and selecting Data Management in Dynamics:


Our top option here is duplicate detection settings, the following pop will appear where we can select to enable duplicate detection.


Our next step is to set our duplicate detection rules, here we can decide our criteria, (Hint: duplication rules are applied as AND statements!).

In this instance we are looking at the Contact entity record and we want the detection tool to alert us if the first name, last name and customer are an exact match:


Once we are happy with our criteria, we can publish the rule to start this operating in Dynamics. (this behaves in a similar fashion to Activating or Deactivating a Workflow in Dynamics)

With the Rule Published, we can then see this in action in Dynamics - in the below image a new contact has been created, and upon trying to save the new contact, we see the following pop-up error message:


Here we can see that there has already been a contact saved under the same details, we can then decide how we want to proceed.

This functionality is can be cumbersome as the warning is only shown on-Save of the record, as opposed to a search-as-you-type format; but the use of bespoke Rules allows for a huge degree of flexibility to Duplicate Check across different Entities (to check new Leads against existing Contacts for example), and to incorporate Checks into any new Custom Entities we add into our Dynamics Solution.

The Duplicate Detection logic can also be used as a Scheduled Task to produce a Overnight Report that highlights all duplicates within a specified time period.

So now we have walked through the basic fundamentals of the duplicate detection tool within CRM, It is important to note that the duplicate detection tool in CRM is useful in IDENTIFYING duplicates, however will not resolve these duplicates, this is up to the user on how to proceed.

For this however, Dynamics does provide us with excellent functionality for Merging Records as way of resolving duplicates.


Whilst a useful tool to aid quality of data in CRM this Deduplication and Merge is not an entirely autonomous or intelligent system, so spelling errors and data imports may allow loop holes in how clean our data can be.

However as Machine Learning improves in how automated systems can look at data and identify previously unseen connections or problems, this could change in the future. 

We can see some of this functionality in place in the new Relevance Search in Dynamics 365, and how this brings Azure Search Analytics into Dynamics – and we could see similar functionality brought into the Duplicate Detection in the future.


Further Reading

Microsoft - Set up duplicate detection rules to keep your data clean


The CRM Book – Keeping Data Clean in Microsoft Dynamics 365


The Marks Group – Dynamics 365 – Duplicate Detection Jobs & Merging Records


Quick Overview of Relevance Search in Microsoft Dynamics 365


Share this Article

Search Articles

Filter Articles

CRM Tech DocMan

Recent Articles

Dynamics 365 Marketing vs ClickDimensions It’s time to pause, reflect and acknowledge a new era of inclusivity and collaboration. Part 2 - How to get the most from a Technology Expert – Asset Management Hub Property & Asset Management Hub Part 1 – Balancing CRM and Asset Management Scopes - Asset Management Hub Creating a Multi-Lingual PowerApps Portal How to Set Up a Microsoft Teams Site Using DocDrive365 Microsoft Teams - Adding a Microsoft Teams URL to a Dynamics Appointment Dynamics 365 Marketing – Customer Voice Survey Not Appearing In Emails? Using SQL Management Studio to connect to the Dynamics DB Calling a Power Platform AI Builder Model via oData How to use DocDrive365 to integrate permissions between Business Units in Dynamics with Sites in SharePoint Getting started with the Power Platform AI Builder. Power Apps Portal Information Hub DocDrive365 Security: Day One - Getting Started with Dynamics to SharePoint Permissions Part 5 - Power Apps Portals: How To Connect Azure B2C With Linked-In Part 4 – Power Apps Portals: Styling Azure B2C for Power Apps Portals The 3 Phases for Using Multi-Select Option Sets in Flow with Microsoft Forms Part 3 – PowerApps Portals: Azure B2C and Power Apps Portals – User Flow for Signup and Signin Part 2 - Power Apps Portals: New Application Registration in Azure B2C for our Power Apps Portal Part 1 – Power Apps Portals: Creating a New Azure AD B2C Tenant The Automation Bot: Launching Contextual Flow from Teams Creating a New Bot for Teams Debugging your Teams Bot using Ngrok Adding a Microsoft Teams URL to a Dynamics Appointment
Contact Us

Want expert advice or a demo?

Get in touch now and see how we can help your business grow.

  • Name
  • Email Address
  • Phone Number

Understanding Your Challenges

Our strong understanding of CRM and emerging technologies within the Microsoft environment means we deliver the right solutions for you.

Proven Real-World Solutions

As a leader in the field of Dynamics solutions, our pedigree developing and delivering real-world solutions is unsurpassed.

Long Term Support

We provide support beyond our design, implementation and 'go-live' delivery using Sprints and continual updates to our AppSource apps.

CRMCS | Design by Thinktank Marketing | Citrus-Lime Limited

To improve your experience today and in the future, this site uses cookies. Read our full Privacy Policy & Cookie information here I Understand