Avoidance of Infinite Iterations of Until activity within Azure Data Factory / Synapse Pipelines

Problem Statement : In case if there is a failure of any activity inside an Until activity and the termination condition is not being met, the Until activity would go under infinite executions. So how to avoid infinite executions in case of some error or exception scenarios. Pre set up : Infinite Iterations in case ofContinue reading “Avoidance of Infinite Iterations of Until activity within Azure Data Factory / Synapse Pipelines”

Error Logging and the Art of Avoiding Redundant Activities in Azure Data Factory

Problem Statement : In my previous blog of Identifying the Count of Activities within a Pipeline in an Azure Data Factory , we saw how Azure Data Factory has a limitation of only 40 activity per pipeline and how we can measure the count of activities. Because of this limitation, managing logging framework by avoiding redundantContinue reading “Error Logging and the Art of Avoiding Redundant Activities in Azure Data Factory”

Design a site like this with WordPress.com
Get started