Identifying the Count of Activities within a Pipeline in an Azure Data Factory

Problem Statement :

As of Aug 15,2021 ; there is a limitation in Azure Data Factory V2 wherein a user can add only 40 activities within a pipeline and in case if the number of activities within a pipeline exceeds 40, the user gets the below error:

So how can one get the count of activities within an existing pipeline.

Prerequisites :

1. Azure Data Factory
2. Powershell

Solution :

1. Open Powershell in admin mode and import the Azure SDK modules by executing the below commands :

Import-Module Az.Accounts Import-Module Az.DataFactory

2. Install the custom module by executing the below command

Install-Module -Name AzDataFactoryV2Activities

3. Now the environment is set for us to execute the commands to fetch the pipeline details .

To get the list of all pipelines in an ADF and its corresponding activity list and activity count, execute the below command: Get-AzDataFactoryV2Activities -ResourceGroupName “<<RGName>>” -DataFactoryName “<<ADFName>>”

To get the details of a specific pipeline in an ADF and its corresponding activity list and activity count, execute the below command: Get-AzDataFactoryV2Activities -ResourceGroupName “<<RGName>>” -DataFactoryName “<<ADFName>>” -PipelineName “<<PipelineName>>”

Output Results :

1. Overall ADF output

2. Specific Pipeline output

This would avoid manually counting the number of activities within any pipelines.