Product Release 2024-05-22

by Margot Lepizzera

✨ Feature Highlights

Document and Classify Your Data in One-Click

You can now enrich your Data Catalog in one-click thanks to Sifflet AI Assistant new capability. Clicking the Generate metadata button on your data assets now indeed generates:

  • Columns classification suggestions to help teams categorize Tables & Views assets' columns in a more accurate and comprehensive manner.
  • Descriptions recommendations to enrich data assets documentation and ensure the content of datasets' columns is clear to all data stakeholders.

Learn more about AI Suggestions

Select Multiple Tables in Custom SQL Monitors

Available for Custom Metrics and Custom SQL

You can now select multiple tables when creating a Custom SQL monitor, this will allow the monitor to be linked to multiple tables at once but what it also truly unlocks is the power of AI to generate even more advanced Monitors, joining tables automatically and on demand !

Sifflet's AI Assistant will attempt to join tables together with the context of the tables' schemas and column descriptions! (if you identify your column as foreign key in the description that will be taken into account! )


🛠 Fixes

  • [Data Catalog] Fixed a bug that was preventing some search parameters (search terms, search on fields selection, page, and number of items per page) from being maintained during a Data Catalog navigation.

App version: v252

Product Release 2024-05-14

by Margot Lepizzera

✨ Feature Highlights

Freshness Improvements

Sifflet has in the past primarily been doing Freshness based on the distribution of the data, checking that data points with new dates were added. However this does not cover all freshness usecases, such as reloading a dimension table without a date field. In those cases what I want to check if if the data reload occurred within the usual time range !

New Template: Freshness (Update Time Gap)

This template can be applied to any table and will use the Table Metadata available to build up a history of typical time gaps between updates.

Due to the lack of history available, this monitor needs training time to be effective so you will need to wait a few data update cycles for a nice looking graph !


Supported Databases:

  • Snowflake
  • Bigquery
  • Databricks
  • Oracle
  • Mysql


🛠 Fixes

  • Fixed a bug that caused recurring data source update failures in some large environments.

Product Release 2024-05-06

by Margot Lepizzera

Release: New monitors wizard, Rolling aggregation for monitors with dynamic thresholds

✨ Feature Highlights

New monitors wizard

We have improved the monitor's creation experience on the UI by introducing a redesigned wizard. This new user experience streamlines navigation within the monitor's templates, providing users with more precise guidance on setting parameters tailored to their specific use cases. We will continue improving this experience with more to come in the coming releases.

Rolling aggregation for monitors with dynamic thresholds

Introducing a new addition to our monitoring capabilities, detect anomalies using rolling aggregation alongside dynamic thresholds. Every monitor run will aggregate data based on user-defined rolling time intervals. For instance, users can set up monitors to run daily and detect anomalies in the total number of orders over the past seven days using dynamic thresholds. This feature is compatible with the following monitor templates:

  • Metric (Dynamic)
  • Duplicate Count (Dynamic)
  • Duplicate Percentage (Dynamic)
  • Null Count (Dynamic)
  • Null Percentage (Dynamic)


App version: v246

Release: Improved Dataset Selector for Monitoring.

✨ Feature Highlights

Search Datasource Names, Databases and Schema Names in Monitoring Asset Selector

When looking for the right asset to monitor you may find that you have multiple copies of the same name! If you know the datasource name, schema or database you are now able to add those to your search and find your asset faster

Search Datasource Names, Schemas and Databases

Search Datasource Names, Schemas and Databases


Product Release 2024-04-15

by Margot Lepizzera

Release: Synapse integration

✨ Feature Highlights

Synapse Integration

Sifflet now supports Azure Synapse dedicated SQL pool. Users can connect Sifflet to their Azure Synapse for documentation purposes through the catalog and apply all Sifflet monitors to their data assets to achieve data trust. Read this documentation to learn more about the integration steps.

App version: v226

Release: Improved Domain Asset Selection

✨ Feature Highlights

New and Improved Domain Asset Selection!

Sifflet Admins can create domains to organise and limit access to a portion of all the catalogued assets available in Sifflet. After many discussions with you, our customers!, this process has now been drastically improved.

Domains ensure your SIfflet users can only see/monitor the assets that they should!

Domains ensure your SIfflet users can only see/monitor the assets that they should!

The asset selection has been improved to reflect the same User Friendly experience you're familiar with in the Data Catalog section of sifflet!

Search and Filter to find the relevant assets and add them to your domain in a few clicks!

Selects assets as you would in the Sifflet Catalog!

Selects assets as you would in the Sifflet Catalog!

Your assets neatly display in your domain ready for reviewing and saving!

Your assets neatly display in your domain ready for reviewing and saving!

What's Next for Domain Asset Selection? - Dynamic filters, when you don't want to select specific assets, specify a filter&search criteria and assets will automatically be added to the domain !

App version: v229

Release: Contextualized Text-To-SQL

✨ Feature Highlights

Custom SQL monitors without having to write any code

Custom SQL monitors are powerful, however they rely on strong SQL skills... No More !

Sifflet's AI Assistant can now generate SQL for you! And that's not all, Sifflet leverages the power of all the documented context of your catalog to better understand your prompts!

Sifflet's AI Assistant understands the context of your data

Sifflet's AI Assistant understands the context of your data

Create powerful monitors in a few seconds. Sifflet identifies the best fields based on catalog documentation. Order_Cost = order preparation

Create powerful monitors in a few seconds. Sifflet identifies the best fields based on catalog documentation. Order_Cost = order preparation

Apply complex Business Logic checks in seconds

Apply complex Business Logic checks in seconds

Available For Custom SQL monitors. Coming soon to Custom Smart Metrics !

Fix SQL with AI for Custom SQL Monitors

Sometimes it's hard to write SQL correctly, if the Test Run fails Sifflet will now display the option to use AI to attempt to generate correct SQL!

In this case I called the wrong column !

In this case I called the wrong column !


App version: v228

Product Release 2024-04-04

by Margot Lepizzera

Release: Business Glossary Sorting Capabilities

✨ Feature Highlights

Business Glossary Sorting Capabilities

You can now sort business terms by name or by number of assets & monitors using them. This makes it simpler for your teams to navigate the Business Glossary and find terms that matter the most to them.

Read more about the business glossary

🛠 Fixes

Automatic qualifications done by Sifflet are now marked as Sifflet

App version: v225

Product Release 2024-04-02

by Margot Lepizzera

Release: Preview Sample Data of All Table Columns in One-Click, Email Integration UI Revamp

✨ Feature Highlights

Preview Sample Data of All Table Columns in One-Click

You can now preview a sample of all your table columns in one-click, making it even simpler to get an overview of what your table data actually looks like.

Read more about data preview

Email Integration UI Revamp

In addition to recent changes ensuring Sifflet users' email addresses are automatically configured (See v216 changelog), the email integration just got entirely revamped in order to:

  • Give it a fresh look and make it easier to differentiate users' email addresses from custom ones
  • Simplify the configuration of multiple custom email addresses in one go
  • Allow you to delete custom configured email addresses from the integration and monitors

Read more about email integration

🛠 Fixes

  • Improved behaviour when scrolling on graphs
  • Fixed issue where clicking on a point to qualify it would not register

App version: v222

Product Release 2024-03-27

by Margot Lepizzera

Release: Qualification Comments

✨ Feature Highlights

Qualification Comments

A long awaited feature ! You can now add qualification comments to graph qualifications in Sifflet.

Qualification comments show in the graph, alongside the user who qualified the point and the date of qualification. Look out for little dots on qualified points, they indicate a comment is available!

Qualification comments show in the graph, alongside the user who qualified the point and the date of qualification. Look out for little dots on qualified points, they indicate a comment is available!


App version: v220