Please put in your email address below if you would like to subscribe to DataSharkX blog posts.
Latest Posts :
- Error Logging and the Art of Avoiding Redundant Activities in MSFT Fabric Data Pipelines
- Refresh Power BI Semantic Model from MSFT Fabric Data Pipeline
- Data Vault design in Azure SQL – Utilizing Customer keys to read PII information in databases
- Automated Way to Get Latest Pipeline Execution Details of Synapse
- Automated Way to Get Latest Pipeline Execution Details of an Azure Data Factory
Blogs Till Date (Ascending) :
- Automated Deployment of Azure SQL Database/ Azure SQL Data warehouse through Azure Devops via Service Principal – Part 1
- Automated Deployment of Azure SQL Database/ Azure SQL Data warehouse through Azure Devops via Service Principal – Part 2
- Refresh SSAS Tabular Model from Azure Data Factory
- Copy Data from SSAS/AAS through Azure Data Factory
- Automated Deployment of Master Data Service (MDS) through Azure Devops
- Creating One’s Personal Active Directory and Switching Azure Subscription to the new directory
- Inviting Guest User Accounts with no Mail Enabled to an Azure Active Directory
- Automated Deployment of SQL Server Database through Azure Devops
- Security Access to Trigger a specific Pipeline in Azure Data Factory
- Identifying the Count of Activities within a Pipeline in an Azure Data Factory
- Error Logging and the Art of Avoiding Redundant Activities in Azure Data Factory
- Creating One’s Personal Power BI Sandbox Environment for Free Access to all Power BI Service Features (Including Admin Portal)
- Granting Admin Access on a Schema in Azure Database / Synapse Dedicated Pool to an Azure AD Group
- Listing Unique records within an Array in Azure Data Factory
- Avoidance of Infinite Iterations of Until activity within Azure Data Factory / Synapse Pipelines
- Iterating across all Excel Sheets dynamically and Converting into CSV files via Azure Data factory / Synapse Pipeline
- Iterating across all Excel Sheets Dynamically and Converting into CSV files via Azure Data factory / Synapse Pipeline Parallelly
- Event Trigger of Synapse / Azure Data factory Pipeline on Arrival of N’th File in Azure Blob Storage
- Event Trigger Data Sync from SQL Server to Synapse via Azure Data Factory / Synapse Pipeline
- Copy Data from Power BI through Azure Data Factory / Synapse Pipeline – Part 1
- Copy Data from Power BI through Azure Data Factory / Synapse Pipeline – Part 2
- Copy Data from Power BI through Azure Data Factory / Synapse Pipeline – Part 3
- Copy Data from Power BI through Azure Data Factory / Synapse Pipeline via Managed Identity Authentication– Part 4
- Refresh Power BI Dataflow / Dataset from Azure Data Factory / Synapse Pipeline via Managed Identity
- Refresh Power BI Dataflow / Dataset from Azure Data Factory / Synapse Pipeline via Service Principal (AAD Token Generation)- Part 1
- Refresh Power BI Dataflow / Dataset from Azure Data Factory / Synapse Pipeline via Service Principal – Part 2
- Identifying the Count of Activities within a Pipeline in Synapse
- Event Trigger Power BI Dataset / Dataflow Refresh via Azure SQL Database
- Event Trigger Azure Data Factory / Synapse Pipeline via Azure SQL Database
- Extract Data from Power BI through Azure Data Factory / Synapse Pipeline via T-SQL From Azure SQL Database
- Granting Access to Similar Name Applications in Azure SQL Database / Synapse
- Automated Way to Identify the Dependencies on a Linked Service in an Azure Data Factory
- Automated Way to Identify the Dependencies on a Dataset in an Azure Data Factory
- Automated Way to Identify the Dependencies on a Dataflow / Power Query in an Azure Data Factory
- Automated Way to Identify the Dependencies on a Trigger in an Azure Data Factory
- Automated Way to Identify the Dependencies on an Integration Runtime in an Azure Data Factory
- Automated Way to Identify the Dependencies on a Trigger in Synapse
- Automated Way to Identify the Dependencies on a Linked Service in Synapse
- Automated Way to Identify the Dependencies on a Dataflow in Synapse
- Automated Way to Identify the Dependencies on an Integration Runtime in Synapse
- Automated Way to Identify the Dependencies on a Dataset in Synapse
- Get Latest Folder / File Detail from Azure Data Lake Storage via Synapse / Azure Data Factory Pipeline
- Trigger Azure DevOps Build Pipeline via Azure Data Factory / Synapse Pipeline
- Overcoming Limitations of Get Metadata Activity in Azure Synapse / Data Factory
- Merging Arrays within Synapse / Azure Data Factory Pipeline
- Appending String to every Element of an Array without using Iteration Activities via Synapse / Data Factory Pipeline
- Calculate Folder Size of an Azure Blob Storage / Data Lake Storage via Synapse / Data Factory Pipeline
- Replace Nth Index Item of an Array via Azure Data Factory / Synapse Pipeline through Regular Expressions
- Swapping Two Array Elements in Azure Data Factory / Synapse Pipeline via Regular Expressions
- Sort an Array in Azure Data Factory / Synapse Pipeline via Regular Expressions
- Reversing an Array in Azure Data Factory / Synapse Pipeline via Regular Expressions
- Overcoming Data Size / Row Limitations of Power BI REST API for Automated Data Extraction from Dataset
- Implementing ROUND, FLOOR and CEILING Function in Data Factory / Synapse via Pipeline Expressions
- Moving Delta / Missing Files between Source and Sink Via Azure Data Factory / Synapse Pipeline
- Copying Variable / Parameter into Sink (Azure Blob Storage, Azure Database etc.) via Data Factory / Synapse Pipeline
- Trigger Synapse / Azure Data factory Pipeline via SQL Server on Events within the Database
- Automated Way to get the ID of User Manually Triggering the Azure Data Factory Pipeline
- Auto Cancel Long Running Pipelines within Synapse / Azure Data Factory
- Implementing DATEDIFF function in Data Factory / Synapse via Pipeline Expressions
- Copy Data from Azure Analysis Service (AAS) through Microsoft Fabric
- Automated Way to Extract Data from Power BI Dataflow via MSFT Fabric
- Read and Import Data from PDF File using MSFT Fabric
- Automated Way to Get Latest Pipeline Execution Details of an Azure Data Factory
- Automated Way to Get Latest Pipeline Execution Details of Synapse
- Data Vault design in Azure SQL – Utilizing Customer keys to read PII information in databases
- Refresh Power BI Semantic Model from MSFT Fabric Data Pipeline
- Error Logging and the Art of Avoiding Redundant Activities in MSFT Fabric Data Pipelines