Freshness (Update Time Gap)
Overview
The Freshness(Update Time Gap) monitor detects when the time between ingestion diverges from the regular timeline.
Metadata MonitoringMetadata can be defined as information about data, including its structure and transformations applied to it. Metadata monitoring helps identify and address issues related to data integration, and data transformations.
As data volumes and complexities continue to grow, metadata monitoring is becoming increasingly crucial for maintaining a reliable and trustworthy data ecosystem.
How to
Parameters
Excluded Dates: Select a calendar (e.g., France Public Holidays, Weekends) to exclude specific days from alert and incident creation.
Training Time
Due to the lack of history available, this monitor needs training time to be effective, so you will need to wait a few data update cycles.
Schedule
This monitor depends heavily on a schedule, if you refresh your data every day, ensure you run this monitor every hour!
RecommendedUse an @hourly schedule to get one point per hour
Graph
The freshness(Update time Gap) graph shows the number of hours/days since the last update.
Supported Databases
- Snowflake
- Bigquery
- Databricks
- Oracle
- Mysql
Updated 20 days ago