Product Release 2023-04-12

by Wissem Fathallah

Release: Usage information on Tableau dashboards

✨ New & Improved

Tableau Usage (beta): We are extending our data assets usage to Tableau dashboards. With this release, Tableau users can identify the most and least popular dashboards based on the number of views. With this visibility, data teams can better prioritize data quality incidents for business-aware troubleshooting.

🛠 Fixes

We have fixed a Bug in the Slack integration preventing users from connecting their Slack to Sifflet and refreshing their channels list.

App version: v130

Release: New Catalog and new ML-based monitoring on data assets without time fields

✨ New & Improved

  • New Catalog and data assets pages: Introducing our new catalog to make it easier for data users to find and access the data they need and get all its context and health status in one central place. This includes advanced filtering to narrow down search results, more insights around the data assets, and better navigation between different pages and sub-pages.
  • ML-based monitoring on data assets without time fields and Time Travel support: Users can now create ML-based monitors on tables and views even if it does not have any time field. Leveraging Time Travel capabilities on BigQuery, Databricks, and Snowflake, ML-based monitors can track how the data has been changing to detect data quality anomalies by traveling in its past versions.
    If users do not have Time Travel on their data warehouses, the monitors will continuously take snapshots of the data at every run to reproduce the time-traveling capability.

🛠 Fixes

We have fixed minor bugs impacting partitioned tables monitoring and lineage computation between Tableau and data warehouses.

App version: v126

Minor Release: Fixed a bug on some graphs

🛠 Fixes

  • Fixed a bug on some graphs which did not display the correct confidence band

App version: v125

Release: Declarative Lineage and BigQuery Partition Tables

✨ New & Improved

  • BigQuery Partition: Sifflet now automatically ingests BigQuery partitions. They will directly reflect in your Monitors settings
  • Declarative Lineage: In some cases, Sifflet doesn't have enough pieces of information to retrieve and compute the lineage, in particular for orchestrators like Airflow. For these cases, you can now add programmatically the links and nodes in your lineage. Users can declare and associate your orchestrator node to your dbt model.
    You can find more information here.

App version: v124

Minor release: support for dbt Cloud on other regions

✨ New & Improved

dbt Cloud: Sifflet now supports dbt Cloud hosted on different regions

App version: v122

Minor release: Snowflake Usage improvement and bugfixes

✨ New & Improved

Snowflake Usage improvement: Sifflet now computes the data assets usage more reliably

App version: v121

Minor release: a bugfix on Slack alerting

🛠 Fixes

  • Fixed a bug on the Slack connection that would prevent from retrieving all channels

App version: v120

✨ New & Improved

ML Lookback period for data querying optimization: We have added more flexibility to how users can optimize the data querying for ML models. For reference, when activated, the ML models build the training dataset incrementally based on recent data points instead of scanning the whole history each time the model retrains. With this release, users can customize the width of the lookback period in time units (weeks, days, hours).

🛠 Fixes

  • Fixed a bug that would sometimes prevent Sifflet from retrieving the dbt Cloud artifacts
  • Fixed a bug where some dbt tests were not appropriately deleted after the dbt source deletion

App version: v119

Minor release: some bugfixes on monitors

✨ New & Improved

Support for Azure Active Directory: You can rely now on Azure AD a new supported IdP for SSO on Sifflet.

🛠 Fixes

  • Fixed a bug on the interlinked metrics and schema change monitoring templates, preventing in some occasions from triggering notifications on Slack.

App version: v118