Identifying the Count of Activities within a Pipeline in Synapse

Problem Statement :

As of Nov 12,2022 ; there is a limitation in Synapse wherein a user can add only 40 activities within a pipeline and in case if the number of activities within a pipeline exceeds 40, the user gets the below error :

So how can one get the count of activities within an existing pipeline.

Prerequisites :

1. Synapse
2. Powershell

Solution :

1. Open Powershell in admin mode and import the Azure SDK modules by executing the below commands :

Import-Module Az.Accounts Import-Module Az.Synapse

2. Install the custom module by executing the below command

Install-Module -Name AzSynapseActivities

3. Now the environment is set for us to execute the commands to fetch the pipeline details .

To get the list of all pipelines in Synapse and its corresponding activity list and activity count, execute the below command: Get-AzSynapseActivities -WorkspaceName “<WorkspaceName>”

To get the details of a specific pipeline in Synapse and its corresponding activity list and activity count, execute the below command: Get-AzSynapseActivities -WorkspaceName “<WorkspaceName>” -PipelineName “<PipelineName>”

Output Results :

1. Overall Synapse output

2. Specific Pipeline output

This would avoid manually counting the number of activities within any pipelines.