Monitors setup

You can manually create a Monitor in the Monitoring page by clicking on the New button, on the top-right of your screen. Compared to Auto-Coverage, you have access to a broader range of monitoring logics for your data assets.

The first step is selecting an asset you want to monitor. Then, you will have to choose the monitoring category to be applied. You have various possibilities depending on your data, your business case and the criticality of that data. Here is the exhaustive list of all available templates.

You have the possibility to implement a monitor based on either static or dynamic thresholds computed with machine learning models. What we advise is to use:

• Static: for known business cases. For instance, when you want to monitor a price that must remain within a given price range.
• Dynamic: when you don't have specific thresholds but still want to detect any anomaly.

If you use an ML-based monitor, an important parameter will be the historic: the number of minutes, hours or days of recorded data on which ML models will train. You should select this parameter according to the business periodicity you want to be detected by the model. By default, the model will train on one year of data.

For all monitors, it is possible to add a WHERE clause using an appropriate SQL syntax, to filter records with conditions.

Finally, GROUP BY will enable you to increase the granularity of your monitoring. Each unique value of the selected field will be sub-monitored within the run of your monitor.

You will receive a granular success or failure status for each dimensional value tested.