Monitor Overview

In Sifflet, a Monitor is a check that evaluates the quality of one or more data assets.

Monitors can be set both on a table or a field level in order to control specific Data Quality criteria. They can be run manually or automatically based on a Schedule, they can scan partially or entirely the table depending on their Scan Mode, they have a Threshold to determine whether the observed value is an anomaly, and they can alert users in case of an anomaly (see: Notifications).

Monitor Status

Here is the list of all possible monitor statuses:

  • Passing: Assigned when all data points are OK or qualified, meaning no unresolved anomalies.
  • Failing: Applies when at least one anomaly remains unqualified.
  • Needs Attention: Applies to monitors that did not run correctly. (Merges the previous Requires Your Attention and Technical Error statuses into one, clearly signaling monitors that need immediate action.)
  • Not Evaluated: Applies to monitors that have never been executed.

Monitor Run Status

Here is the list of all possible monitor run statuses:

  • Success: Applies when no anomalies were detected or anomalies that were already known.
  • Failed: Applies when a new anomaly was detected.
  • Requires your Attention: Applies when there is a client-side problem (e.g., incorrect user permissions, …)
  • Technical Error: Applies when Sifflet had an internal issue.