Product Release 2023-09-11

by Margot Lepizzera

Release: Monitors as code, Revamped Slack integration

✨ New & Improved

  • Monitors As Code: Monitors As Code aims to allow data engineers to create and maintain monitors programmatically. This new capability enables technical teams to consolidate the monitoring and the management of their pipelines in one place, provide efficient scalability to the monitoring, and apply engineering principles and best practices to data observability.
  • Slack Integration: Slack integration got revamped and now supports Slack workspaces with large number of channels, has improved user experience and error handling.
  • Email notifications: You no longer have to whitelist domains to be able to configure email addresses for your monitors.

🛠 Fixes

  • Fixed an issue when exiting full screen lineage using the Esc key

App version: v165

Product Release 2023-08-31

by Margot Lepizzera

Release: Domain regular expressions on data source names

✨ New & Improved

  • Domains: Domain regular expressions are now applied to the data source name to make it easier to assign assets from specific data sources to your domains.

🛠 Fixes

  • Access Tokens: Fixed a bug with the empty state that was preventing access tokens from being created for the first time.
  • Fixed a bug that was preventing sorting from working on certain list pages of the app.

App version: v163

Product Release 2023-08-07

by Margot Lepizzera

Release: Notifications on incident assignment/unassignment, Access Tokens new roles, Revamped Users page UI

✨ New & Improved

  • Incidents: Automatically receive email notifications when assigned to or unassigned from an incident to ensure no ongoing issue gets overlooked by your team.
  • Access Tokens: Create access tokens with the role that is the most appropriate to the programmatic interaction you are building for better access controls.
  • Users: Revamped UI for smoother user management process.

🛠 Fixes

  • Monitors: Fixed a bug that was preventing monitors on partitioned tables from being saved.

App version: v158

Product Release 2023-08-01

by Margot Lepizzera

Release: Sum metric monitor template, BigQuery partitioned table monitoring, Redshift & SQL Server SSL connection

✨ New & Improved

  • New metrics monitoring template: Monitoring fields' sums with static thresholds.
  • BigQuery partitioned tables monitoring: If you are using ML-based monitors on partitioned tables, enabling the auto setting for the time field will use by default the partition key when it is a timestamp/date field.
  • Redshift and SQL Server SSL connection: Improved security with SSL connections for both Redshift and SQL Server.

🛠 Fixes

  • Lineage: Fixed a bug preventing lineage from being exported in .csv.
  • Flow stopper: Modified the CLI to remove unnecessary dependencies in the Sifflet Provider for Apache Airflow.

App version: v157

Product Release 2023-07-11

by Margot Lepizzera

Release: Access Controls Updates, Auto-Coverage Improvements

✨ New & Improved

🛠 Fixes

  • Monitors: Fixed a bug where interlinked metric monitors that used a single dataset could not be edited.
  • Usage: Fixed a bug where Snowflake assets' usage was not computed in some specific cases.

App version: v153

Release: Freshness monitor improvement, Add button to copy datasource parameters, Reflect data technologies casing on the Data Catalog

✨ New & Improved

  • Enhanced Freshness monitor: Introducing one additional mode for the freshness monitor, catering to different use cases. You can find more details here.
    • Static Mode: Detects whether data has arrived or not. It corresponds to the previous existing monitor
    • Dynamic Mode: Detects whether data has arrived based on an injection pattern.
  • Improved Datasource Creation: You can now easily create new datasources by copying parameters from existing ones.

  • Improved Data Catalog: Asset pages of the Data Catalog now reflect the casing used in your data technologies. You can find more details here.

App version: v152

Release: Declarative Lineage on edges, new integrations on Oracle and Atlas on Cloudera

✨ New & Improved

  • Declarative Lineage for edges: In some cases, Sifflet cannot connect to your closed environment or doesn't have enough access to retrieve and compute the lineage. For these cases, you have the possibility to add programmatically the edges in your lineage.
  • Atlas (beta): You can now connect to your Atlas instance along your Hive instance on Sifflet.
  • Oracle (beta): You can now connect to your Oracle instance.

🛠 Fixes

  • Fixed errors on some MySQL monitors
  • Access Controls: Improved UX for users with "Viewer" roles trying to create monitors from the app.

App version: v147

Product Release 2023-06-09

by Margot Lepizzera

Release: Improved Lineage, Data Catalog Columns Description Bug Fix

✨ New & Improved

🛠 Fixes

  • Data Catalog: Descriptions of Tables & Views assets' columns without any Sifflet description configured no longer show up as undefined

App version: v145

Product Release 2023-06-07

by Margot Lepizzera

Release: AI Suggestions for dataset columns descriptions, conditional monitors for Hive data assets

✨ New & Improved

App version: v144

Product Release 2023-06-06

by Margot Lepizzera

Release: Business Glossary, improved multidimensional monitoring, notifications, and lineage

✨ New & Improved

  • Business Glossary: Build a common knowledge of key business terms across your company to avoid misunderstandings and foster a data driven culture for all stakeholders
  • Improved Multidimensional Monitoring: You can now create monitor data quality with up to 1000 different dimensions
  • Improved Notifications: Quickly access failing monitors and generated incidents from your notifications
  • Improved Lineage: Visual improvements on the lineage

App version: v143