{"id":99,"date":"2021-12-01T16:05:04","date_gmt":"2021-12-01T16:05:04","guid":{"rendered":"https:\/\/blog.citrus-lime.com\/crmc\/?p=99"},"modified":"2021-12-01T16:05:05","modified_gmt":"2021-12-01T16:05:05","slug":"using-power-automate-to-synchronise-a-sql-back-end-to-dataverse-front-end","status":"publish","type":"post","link":"https:\/\/blog.citrus-lime.com\/crmc\/using-power-automate-to-synchronise-a-sql-back-end-to-dataverse-front-end\/","title":{"rendered":"Using Power Automate to synchronise a SQL Back-End to Dataverse Front-End"},"content":{"rendered":"\n

Power Automate gives us a useful tool to integrate data between systems in the cloud. <\/p>\n\n\n\n

This article will take the scenario where we have a collection of data in SQL that we want to integrate into the Dataverse Database for use in PowerApps \u2013 focusing on how we can pass User Roles and Teams where we may need this data present to help manage security rights. <\/p>\n\n\n\n

Introduction\u00a0<\/a><\/h3>\n\n\n\n

DoOften, you may have information about users stored in your SQL server which you want to integrate in your Dataverse teams? This , so this article will guide you through how to set up a Power Automate Flow to associate Users to the connect Teams based on a separate SQL Database.   <\/p>\n\n\n\n

The example we are using here is from our experience in Asset Management, where each Asset may have its own Team of Stakeholders that we want mapped into PowerApps as a Team to correctly set User permissions to that Asset. populate your teams.  <\/p>\n\n\n\n

This guide will instruct you from the perspective of tables, views and values unique to our work; you may need to adapt this to match your server and tables.<\/p>\n\n\n\n

Step\u00a01:\u00a0Opening Power Automate\u00a0<\/a><\/h3>\n\n\n\n

First, you will need to log into your Office 365 account on your web browser. From there you will need to navigate to Power Automate using the menu bar on the left. https:\/\/www.office.com\/<\/a>  <\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Step 2:\u00a0Creating the Flow\u00a0<\/a><\/h3>\n\n\n\n

Once you\u2019reNow we are in Power Automate, you will need to create a new Flow. The side-menu will bring you to the Create page, from where you can select the type of Flow you want to build. We suggest using a scheduled cloud flow to make sure your data stays up to date with any changes made in SQL. <\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Step 3:\u00a0Connect to\u00a0the\u00a0SQL\u00a0Database\u00a0<\/a><\/h3>\n\n\n\n

The first and most important step to add is the SQL Server action Get Rows (V2). This is the action which will retrieve the data from your SQL server to bring into your Dataverse tables. You will need to set up a connection with your SQL Server, for which there are multiple options, but we recommend using the SQL Server Authentication option.  <\/p>\n\n\n\n

For this, you will need the server and database name you are getting your data from, and the username and password for your server. However, any other method will work too, so you can pick the option which works best for you. <\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Step\u00a04:\u00a0Read or Select from the SQL Table or View\u00a0<\/a><\/h3>\n\n\n\n

Once you have created your server connection, you will be able to select which table or view you want to read your data from. For this example, we will be using the Roles view, as the Asset ID in this table tells us which team each user should be allocated to. <\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Note. If you have any criteria for which records you want to bring through, you can select the advanced options button to get access to the various fields which let you filter the data, but if you want to bring through all of your records, leave these fields blank instead. <\/p>\n\n\n\n

Step 5:\u00a0Doing the Flow Right with Variables\u00a0<\/a><\/h3>\n\n\n\n

Next, you can initialise a series of variables to be populated later in the flow. This step is optional, but it is recommended as it will help you manage and track the information which is required for the lookup fields and relationships later down in the flow. When initialising variables, it is important to give them all distinct names so that you do not set or call the wrong variable at the wrong time. <\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Step 6:\u00a0Avoiding\u00a0Hard-Coding\u00a0the Environments\u00a0<\/a><\/h3>\n\n\n\n
\"\"<\/figure>\n\n\n\n

The next stage is used to retrieve configuration details. This step is important as it lets you call upon details for your flow stored within Dataverse which can be edited for each different environment. To ensure that not everything is done in just one flow, retrieving the configuration details is done in a child flow, and the results of this flow are returned as variables for the parent flow to use. <\/p>\n\n\n\n

The actions of this flow returns the details of the data stored in the configuration table (this works best if there is only one record in the table as it means you do not need to filter the table, and the correct details will always be returned), enters the data into the variable and then responds to the parent flow. In our example, we will be returning the email of the configuration user, as it will be important later down in the parent flow. <\/p>\n\n\n\n

This step avoids having to edit your Flows when exporting and importing into future Environments (such as the Test or Production Environments in your Release Cycle) – and keeps to good development practise regardless of working on a low-code or no-code platform like Power Automate. <\/p>\n\n\n\n

Step 7:\u00a0Match the Asset from SQL to PowerApps\u00a0<\/a><\/h3>\n\n\n\n

Back in the parent flow, the next action you will need is an apply to each which uses the value of the Get Rows (V2) action; this ensures the flow cycles through each row returned from the SQL server and applies the same logic to each one.  <\/p>\n\n\n\n

Then, you will need to create a list rows action which returns the asset details, as these details will be used to find the matching team later in the flow. In our example, each team is linked to an asset and the roles table contains an asset ID field.  <\/p>\n\n\n\n

A filter is then used to return the unique GUID of each asset found which matches an asset ID brought from SQL. <\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

This provision to update if existing, insert if not, is key to building a good integration \u2013 as we will avoid duplicating data if a pure insert is run multiple times. <\/p>\n\n\n\n

Step 8:\u00a0Use the right Team\u00a0<\/a><\/h3>\n\n\n\n

Next, the results of the list assets action are used to filter the next list rows action using the owning team ID value. This second list rows action lists the teams which are linked to each asset found, and the unique GUID of this team is then recorded with a set variable action in one of the variables created earlier. <\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Step 9:\u00a0Match the User from SQL to PowerApps\u00a0<\/a><\/h3>\n\n\n\n

The next step requires a third list rows action; this one is used to find the unique GUID of the users who need to be linked with their correct team.  <\/p>\n\n\n\n

Before this action is included, it\u2019s important to note that this action requires the emails listed in the roles table in SQL to already have been created in Dataverse, which can be done through another flow. In order to return the details of the right user, a filter is used which matches the email from the roles table to the email stored in the users table. <\/p>\n\n\n\n

 Then tThe unique GUID is then stored in one of the variables initialised earlier with another set variable action.  <\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Step 10:\u00a0Add the User to the Team for the Asset\u00a0<\/a><\/h3>\n\n\n\n

After this, a condition is used to check if any user has been found which matches the email from the roles table. If a matching user was not found, then an email is sent to the configuration user, with the email address which was identified with the child flow, warning them that an error has occurred. But if a matching user has been found, then a new row is created in the roles table using the information from the roles table in SQL.  <\/p>\n\n\n\n

Then, uUsing the ID variables populated earlier in the flow, the relationship between the user and the team is created, adding the user into the correct team. <\/p>\n\n\n\n

If this Team has 1 or more Security Roles attached, this then immediately applies the permissions granted by that Role to the User who has just joined the Team \u2013 giving us a way for changes in SQL to define the Security Rights available in Power Apps. <\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

NOTE: <\/strong>the Relate Rows Step in Power Automate uses an aspect of the OData Service that is called by a URL and so needs the destination URL included in the action.  This means that we can find the URL of our PowerApps Environment \u2018hard-coded\u2019 in the Flow and so is an important aspect from step 6 to use Environmental Configuration and avoid the Flow being tied to a particular environment. <\/p>\n\n\n\n

This article on our site may be useful here:  https:\/\/www.crmcs.co.uk\/content\/creating-a-flow-to-add-a-many-to-many-relationship.aspx<\/a> <\/p>\n\n\n\n

As is this article from the Power Platform community:  https:\/\/tattooedcrmgirl.com\/2019\/10\/30\/microsoft-flow-the-relate-records-action-demystified\/<\/a>\u200b\u200b\u200b\u200b\u200b\u200b\u200b <\/p>\n\n\n\n

The Benefit\u00a0<\/a><\/h3>\n\n\n\n

Today our solutions may comprise many Apps or Systems, particularly given the ease we can build new Canvas Apps connected to various sources of data.   <\/p>\n\n\n\n

Historically integrating these systems as a single solution could be an expensive and time-consuming job for a development team, often requiring a 3rd Integration Manager such as BizTalk or Scribe \u2013 Power Automate gives us a tool for this kind of low-code connection of data across the cloud that can be simpler, leaner and quicker to apply to our business problems. <\/p>\n\n\n\n

In this example, we see how a SQL Database of Assets and Stakeholders can be integrated into PowerApps so the people related to the Asset (often referred to as the Related Parties) are made available in PowerApps and set the right security permissions. <\/p>\n\n\n\n

Taking this one step further, we used this system to then push the security rights from\u00a0Dataverse\u00a0and into SharePoint so that the right\u00a0Users were able to view the SharePoint Site for that Asset \u2013 giving us a combined security solution between SQL, PowerApps and SharePoint to keep a unified view of security.\u00a0<\/p>\n\n\n\n

FURTHER READING<\/strong><\/p>\n\n\n\n

https:\/\/www.crmcs.co.uk\/blog\/blog.aspx<\/span><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

This article will take the scenario where we have a collection of data in SQL that we want to integrate into the\u00a0Dataverse\u00a0Database for use in PowerApps \u2013 focusing on how we can pass User Roles and Teams where we may need this data present to\u00a0help manage\u00a0security rights.\u00a0<\/p>\n","protected":false},"author":43,"featured_media":35,"comment_status":"open","ping_status":"open","sticky":true,"template":"","format":"standard","meta":{"_price":"","_stock":"","_tribe_ticket_header":"","_tribe_default_ticket_provider":"","_tribe_ticket_capacity":"0","_ticket_start_date":"","_ticket_end_date":"","_tribe_ticket_show_description":"","_tribe_ticket_show_not_going":false,"_tribe_ticket_use_global_stock":"","_tribe_ticket_global_stock_level":"","_global_stock_mode":"","_global_stock_cap":"","_tribe_rsvp_for_event":"","_tribe_ticket_going_count":"","_tribe_ticket_not_going_count":"","_tribe_tickets_list":"[]","_tribe_ticket_has_attendee_info_fields":false,"footnotes":""},"categories":[3],"tags":[],"class_list":{"0":"post-99","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-crm"},"featured_image_src":"https:\/\/blog.citrus-lime.com\/crmc\/wp-content\/uploads\/sites\/30\/2021\/11\/Dynamics-365-Consultancy.jpg","author_info":{"display_name":"jadesmith","author_link":"https:\/\/blog.citrus-lime.com\/crmc\/author\/jadesmith\/"},"_links":{"self":[{"href":"https:\/\/blog.citrus-lime.com\/crmc\/wp-json\/wp\/v2\/posts\/99","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.citrus-lime.com\/crmc\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.citrus-lime.com\/crmc\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.citrus-lime.com\/crmc\/wp-json\/wp\/v2\/users\/43"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.citrus-lime.com\/crmc\/wp-json\/wp\/v2\/comments?post=99"}],"version-history":[{"count":1,"href":"https:\/\/blog.citrus-lime.com\/crmc\/wp-json\/wp\/v2\/posts\/99\/revisions"}],"predecessor-version":[{"id":100,"href":"https:\/\/blog.citrus-lime.com\/crmc\/wp-json\/wp\/v2\/posts\/99\/revisions\/100"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blog.citrus-lime.com\/crmc\/wp-json\/wp\/v2\/media\/35"}],"wp:attachment":[{"href":"https:\/\/blog.citrus-lime.com\/crmc\/wp-json\/wp\/v2\/media?parent=99"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.citrus-lime.com\/crmc\/wp-json\/wp\/v2\/categories?post=99"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.citrus-lime.com\/crmc\/wp-json\/wp\/v2\/tags?post=99"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}