Comments for AzureOps

Comment on Azure Data Factory Deployment using Azure DevOps by Jeremiah

Jeremiah — Wed, 27 Oct 2021 16:10:53 +0000

Great article! I just found this after figuring out a similar approach myself, and this describes it well!
Currently I’m trying to figure out how to update global parameters using the DevOps pipeline for different environments and am looking forwards to your article on that.
I see a global parameters file included as part of the NPM-generated ARM template, though I’m not sure how to use a pipeline to override a global parameter name in the xxxGlobalParameters.json file.

Comment on Azure Data Factory Deployment using Azure DevOps by Dick

Dick — Tue, 29 Jun 2021 11:40:40 +0000

Hi Kunal,

I guess I’m doing something wrong, because I run into some errors

PublishConfigService: _getLatestPublishConfig – retrieving config file.
LocalFileClientService: Unable to list files for: integrationRuntime, error: Error: ENOENT: no such file or directory, scandir ‘/home/vsts/work/1/s/integrationRuntime’
LocalFileClientService: Unable to list files for: dataset, error: Error: ENOENT: no such file or directory, scandir ‘/home/vsts/work/1/s/dataset’
LocalFileClientService: Unable to list files for: trigger, error: Error: ENOENT: no such file or directory, scandir ‘/home/vsts/work/1/s/trigger’
LocalFileClientService: Unable to list files for: dataflow, error: Error: ENOENT: no such file or directory, scandir ‘/home/vsts/work/1/s/dataflow’
LocalFileClientService: Unable to list files for: credential, error: Error: ENOENT: no such file or directory, scandir ‘/home/vsts/work/1/s/credential’
LocalFileClientService: Unable to list files for: managedVirtualNetwork, error: Error: ENOENT: no such file or directory, scandir ‘/home/vsts/work/1/s/managedVirtualNetwork’

ERROR === LocalFileClientService: Unable to read file: /home/vsts/work/1/s/arm-template-parameters-definition.json, error: {“stack”:”Error: ENOENT: no such file or directory, open ‘/home/vsts/work/1/s/arm-template-parameters-definition.json'”,”message”:”ENOENT: no such file or directory, open ‘/home/vsts/work/1/s/arm-template-parameters-definition.json'”,”errno”:-2,”code”:”ENOENT”,”syscall”:”open”,”path”:”/home/vsts/work/1/s/arm-template-parameters-definition.json”}
WARNING === ArmTemplateUtils: _getUserParameterDefinitionJson – Unable to load custom param file from repo, will use default file. Error: {“stack”:”Error: ENOENT: no such file or directory, open ‘/home/vsts/work/1/s/arm-template-parameters-definition.json'”,”message”:”ENOENT: no such file or directory, open ‘/home/vsts/work/1/s/arm-template-parameters-definition.json'”,”errno”:-2,”code”:”ENOENT”,”syscall”:”open”,”path”:”/home/vsts/work/1/s/arm-template-parameters-definition.json”}

Are they familiar to you and could you provide a possible solution?

Kind Regards,

Dickkieee

Comment on Azure Data Factory Deployment using Azure DevOps by Kunal Rathi

Kunal Rathi — Sun, 06 Jun 2021 12:09:08 +0000

Hi Kage,
Below is the script you can use to disable ADF triggers. Use Azure PowerShell task for this.
$triggersADF = Get-AzDataFactoryV2Trigger -DataFactoryName $(FactoryName) -ResourceGroupName $(ResourceGroupName)

$triggersADF | ForEach-Object { Stop-AzDataFactoryV2Trigger -ResourceGroupName $(ResourceGroupName) -DataFactoryName $(FactoryName) -Name $_.name -Force }

Script to enable ADF triggers.Use Azure PowerShell task for this.

$triggersADF = Get-AzDataFactoryV2Trigger -DataFactoryName $(FactoryName) -ResourceGroupName $(ResourceGroupName)

$triggersADF | ForEach-Object { Start-AzDataFactoryV2Trigger -ResourceGroupName $(ResourceGroupName) -DataFactoryName $(FactoryName) -Name $_.name -Force }

Make sure to provide variable names to above script.
Hope this helps.

Comment on Azure Data Factory Deployment using Azure DevOps by Kage

Kage — Fri, 28 May 2021 13:48:14 +0000

Hi Kunal, I’ve been putting your blog post to use and I am missing something. I am trying to find the folder that is used for the build because it contains a prepostdeployment script. I can however, not find this anywhere in the repository that I linked. I wanted to add the scripts that MS put on their documentation page to disable and restart the triggers. Mind you I have 0 experience with YAML