Field-level lineage

Having the lineage view at the table level is useful for many tasks. For instance, finding the root cause of a data issue, understanding data dependencies, and so on.
Sifflet now allows you to observe the lineage even further at field-level.
To enable this feature, Sifflet will need read-only access to your SQL logs so that it can automatically detect the dependencies between fields.

You will find below:

  • Coverage: what cases are currently handled
  • Set up: the minimum access rights to enable this feature

Coverage

Most common SQL queries are supported today.
In terms of Data Warehouses, we currently support:

  • Snowflake
  • BigQuery
  • Redshift

Many more will be added regularly.

Set up

Sifflet needs read access on the SQL logs to enable this feature.

  • BigQuery: how to connect to BigQuery on Sifflet is detailed here
  • Snowflake: how to connect to Snowflake on Sifflet is detailed here
  • Redshift: how to connect to Redshift on Sifflet is detailed here