Monitor Consolidation
✨ New Features
Monitor Consolidation
Some big changes happening when it comes to setting up monitors! We've merged a lot of monitors to make them even easier to set up!
Metrics - Replaces All static metric monitors and combines them with the Metrics ( Dynamic ) monitor : Sum ( Static Metrics ) , Average (Static Metrics, ..., Metrics ( Dynamic)
Nulls - Replaces all Null monitors which had different versions for percentages, and for static/dynamic Monitors
Duplicates - Same as Null, Replaces the 4 different monitors to setup duplicate checks!
Improved Threshold Settings for nearly every Monitor
We've standardised Threshold methodologies across most sifflet monitors adding Threshold capabilities to monitors that did not have any! You can now configure format monitors to only alert if there are more than X infringements! Or have relative thresholds for nearly every monitor !
Standardised Time settings !
Static Monitors and Dynamic Monitors in the past had different Time settings, with Static monitors being a bit limited when it comes to incremental checks ! Now every monitor gets a streamlined Time Window Settings, with Rolling aggregations, offsets, first run configurations !
Stay Tuned for a revamped experience for Time Settings this year as well !
Data Quality as code - Version 2
To follow all these improvements we've now updated our Data Quality as Code spec to Version 2. Version 1 specs will still work for now but we heavily recommend switching to Version 2.
kind: Monitor
version: 2
Check out the version 2 doc