Cloud Composer

Cloud Composer is the managed Apache Airflow service offered by GCP. To integrate it with Sifflet, you first need to perform some operations on your GCP account before creating a new source in Sifflet.

1. Create a service account with the suitable role

The first step consists of creating a dedicated service account and providing it with the roles/composer.user role.

Once the service account is created, generate a JSON key for it.

2. Create an Airflow user for the service account

After you have created the service account, you can follow this guide to create an Airflow user for it with the required permissions.

3. Create a new source in Sifflet

Now that you have a service account that can access your Cloud Composer environment, you can perform the following steps in Sifflet:

1. Create a new credential that contains your service account's JSON key.
2. Create a new Cloud Composer source with the following parameters:
   1. Environment name: The name of your Cloud Composer environment.
   2. GCP region: The region in which your Cloud Composer environment is located.