Freshness (Update Time Gap)
Overview
The Freshness (Update Time Gap) monitor detects when the time between ingestions diverges from the regular timeline.
Metadata MonitoringMetadata is information about data, including its structure and the transformations applied to it. Metadata monitoring helps you identify and address issues related to data integration and data transformations.
As data volumes and complexity grow, metadata monitoring helps you keep your data reliable.
How To
Parameters
Excluded Dates: Select a calendar (e.g., France Public Holidays, Weekends) to exclude specific days from alert and incident creation.
Training Time
Because no history is available initially, this monitor needs training time to be effective, so you need to wait a few data update cycles.
Schedule
This monitor depends heavily on its schedule. If you refresh your data every day, run this monitor every hour.
RecommendedUse an @hourly schedule to get one point per hour
Graph
The Freshness (Update Time Gap) graph shows the number of hours/days since the last update.
Supported Databases
- Snowflake
- BigQuery
- Databricks
- Oracle
- MySQL
Updated 1 day ago