Troubleshooting Connectivity

How to debug test authentication errors?

Invalid project ID

Following are the possible error messages for this issue:

Please check your parameters and credentials. Project not found.

BigQuery project not found

Cause

The project ID provided in the connection configuration is incorrect or does not exist.

How to fix

1. Open Google Cloud Console
2. Navigate to IAM & Admin → Settings
3. Copy the Project ID (not the project name).
4. Ensure the same value is used in the Sifflet connection configuration.

Service Account or Authentication Key Issue

Error while listing BigQuery Datasets

Cause

This error can occur if there is an issue with the service account used for the Google BigQuery connection. Common reasons include:

• The service account key has been deleted
• The service account has been disabled
• The service account itself has been deleted

In these cases, Sifflet cannot authenticate with Google Cloud Platform, which prevents it from listing datasets.

How to fix

1. Open Google Cloud Console
2. Navigate to IAM & Admin → Service Accounts
3. Locate the service account used for the Sifflet integration.

Then verify the following:

• If the service account is disabled → Re-enable it.
• If the key was deleted → Create a new key:
  • Open the service account
  • Go to Keys
  • Click Add Key → Create new key
  • Download the JSON key
  • Update the key in the Sifflet connection configuration
• If the service account was deleted → Create a new service account and generate a new JSON key, then update the connection configuration.

Insufficient permissions

During the connection test, Sifflet runs several metadata queries on Google BigQuery. If the service account does not have the required permissions, the connection test may fail with one or more of the following errors.

Users may see one of the following messages during the connection test:

No assets found in this project. Please check that the permission bigquery.datasets.get is granted on the project.

Connection to datasource failed. Please have a look at the test connection report.

The project sifflet-demo-project does not exist or user does not have permission to query table
sifflet-demo-project.INFORMATION_SCHEMA.SCHEMATA.

Access Denied: Permission bigquery.tables.list denied on dataset sifflet-demo-project:Test.

Permission bigquery.jobs.listAll is required to query
sifflet-demo-project:region-US.INFORMATION_SCHEMA.JOBS_BY_PROJECT.

Some permissions are missing:
bigquery.tables.get
bigquery.tables.getData

Why This Happens

These errors typically occur when the service account used to connect Sifflet to BigQuery does not have sufficient permissions.

Sifflet requires permissions to:

• discover datasets
• list tables within datasets
• run metadata queries
• access table schemas
• read sample data
• query job metadata

If any of these permissions are missing, the connection test may fail.

How to Fix the Issue

Follow the steps below to identify and add the missing permissions in Google Cloud Platform.

Identify the Missing Permission

The error message usually contains the exact permission that is missing.

Examples include:

bigquery.datasets.get
bigquery.jobs.create
bigquery.tables.list
bigquery.jobs.listAll
bigquery.tables.get
bigquery.tables.getData

1. Open Google Cloud Console
2. Navigate to: IAM & Admin → Roles
3. Search for the permission (for example bigquery.tables.list) to see which roles include it. This helps determine whether the permission already exists in your IAM roles.
4. Add the Permission and save.
5. Retry the Test Connection