Automated Way to Identify the Dependencies on a Dataflow in Synapse

Problem Statement :

In my previous blog Automated Way to Identify the Dependencies on a Dataflow / Power Query in an Azure Data Factory, we identified ways to get dependencies on a Linked Service within an Azure data Factory. Similarly for Synapse ;

As of Dec 17,2022 ; One can identify the dependencies on a Dataflow in Synapse by logging in to Synapse via Portal and accessing the Dataflow under Develop Section

And Clicking the Related tab would get the Dependencies details as seen below :

A) Pipeline Dependent on Dataflow

So how can one get the related / dependent objects on a Dataflow in Synapse in an automated way.

Solution :

  1. Open Powershell in admin mode and import the Azure SDK modules by executing the below commands :
Import-Module Az.Accounts
Import-Module Az.Synapse

2. Install the custom module by executing the below command

Install-Module -Name AzSynapseDataflowDependencies

3. Now the environment is set for us to execute the commands to fetch the pipeline details .

To get the list of all Dataflows in Synapse and its corresponding dependent objects, execute the below command:

Get-AzSynapseDataflowDependencies -WorkspaceName “<<WorkspaceName>>”
To get the details of a specific Dataflow in Synapse and its corresponding dependent objects, execute the below command:

Get-AzSynapseDataflowDependencies -WorkspaceName “<<WorkspaceName>>” -DataflowName“<<DataflowName>>”

Output Results :

  1. Overall Synapse output

2. Specific Dataflow output

This would avoid manually identifying the dependent objects of a Dataflow in Synapse.

Published by Nandan Hegde

Microsoft Data MVP |Microsoft Data platform Architect | Blogger | MSFT Community Champion I am a MSFT Data Platform MVP and Business Intelligence and Data Warehouse professional working within the Microsoft data platform eco-system which includes Azure Synapse Analytics ,Azure Data Factory ,Azure SQL Database and Power BI. To help people keep up with this ever-changing landscape, I frequently posts on LinkedIn, Twitter and to his blog on https://datasharkx.wordpress.com. LinkedIn Profile : www.linkedin.com/in/nandan-hegde-4a195a66 GitHUB Profile : https://github.com/NandanHegde15 Twitter Profile : @nandan_hegde15 MSFT MVP Profile : https://mvp.microsoft.com/en-US/MVP/profile/8977819f-95fb-ed11-8f6d-000d3a560942

Leave a comment

Design a site like this with WordPress.com
Get started