Release: Differential Static Completeness Template, Dbt Ephemeral Models No Longer Create REF Table in the Lineage, Sifflet Airflow Operators Now Available for Self-Hosted Deployments, SSO Settings Page Revamped User Interface

✨ Feature Highlights

Differential Static Completeness

Sifflet is introducing a new Monitor Template: Differential Static Completeness (available in the Metadata category). It comes with two modes: Absolute and Difference with previous run value and it's especially useful for pipelines in which data gets re-uploaded in its entirety at every update. Use it to make sure that no data gets lost between runs by comparing the number of rows to either an absolute or the previous run value.

Read more about the Completeness (static) Monitor Template.

dbt Ephemeral Models No Longer Create REF Table in the Lineage

As stated in dbt docs, dbt ephemeral models are not directly built in the data warehouse. Therefore, the REF table referring to the DWH table will no longer be created in the lineage view.

Sifflet Airflow Operators Now Available for Self-Hosted Deployments

Self-hosted deployments now support Sifflet Airflow operators. Sifflet Airflow operators allow you to:

Collect dbt models, tests, and lineage data as part of the dbt Core integration
Integrate Sifflet monitors within your data pipelines to proactively prevent data quality issues from propagating (Flow Stopper)

Read more about Sifflet Airflow operators

SSO Settings Page Revamped User Interface

The user interface for the Settings > SSO page was revamped, making the SSO configuration experience smoother.