Azure Data Factory Troubleshooting

This page lists common issues with the Azure Data Factory integration. Test connection and each ingestion run the same checks, so the same errors appear in both places.

Authentication

The Client Secret Is Expired

Symptom:

The client secret of the Azure application is expired. Please create a new client secret in the Azure portal and update the integration credentials.

Cause: the client secret of the app registration reached its expiry date.

Fix:

1. Create a new client secret for the app registration. See Create the App Registration.
2. In Integrations > Credentials, update the credential with the new clientSecret.

Permissions

Access Is Denied or No Data Factory Is Found

Symptom: one of the following errors:

Access denied to data factories in resource group: <RESOURCE_GROUP>. Azure error: ...
No data factories found in resource group: <RESOURCE_GROUP>. Verify that you have read permissions (Microsoft.DataFactory/factories/read).

Cause: the custom role isn't assigned to the service principal on this resource group, it lacks Microsoft.DataFactory/factories/read, or the tenant ID, subscription ID, or resource group name of the source is wrong.

Fix:

1. Check the permissions of the custom role and its assignment to the service principal. See Create the Custom Role and Assign the Role to the Service Principal.
2. Check the tenant ID, subscription ID, and resource group of the source. See Create the Source.
3. Role assignments can take a few minutes to apply: test the connection again.

Missing Assets

No Pipelines or No Pipeline Runs Are Found

Symptom: one of the following errors:

No pipelines found in Data Factory: <DATA_FACTORY>. Verify that you have read permissions (Microsoft.DataFactory/factories/pipelines/read).
No pipeline runs found in Data Factory: <DATA_FACTORY>. Verify that you have read permissions (Microsoft.DataFactory/factories/querypipelineruns/read).

Cause: the custom role lacks Microsoft.DataFactory/factories/pipelines/read or Microsoft.DataFactory/factories/querypipelineruns/read, or the data factory has no pipeline, or no pipeline run in the last 365 days.

Fix:

1. Check that the custom role has both permissions. See Create the Custom Role.
2. If the data factory named in the error has no pipeline or no run in the last 365 days, run a pipeline in it, then test the connection again.