Understanding time partitioning
Every monitor requires a time partition field, such ascreated_at
or date
. This field defines how data is grouped over time and is used to determine which records belong to a given measurement window.
You can then choose how frequently to measure the data — daily, hourly, or down to minutes — and optionally define a delay to account for late-arriving data.
Scheduling options
Each monitor run is defined by three parameters:- Frequency – how often the monitor runs (e.g. daily, hourly).
- Partition time – the timestamp field used to group data.
- Time zone and offset – when in the day the monitor executes.
Common scheduling examples
- Daily at midnight UTC Measures data for the previous calendar day.
- Daily at 2 AM UTC Measures data for the previous calendar day at 2AM (useful for delayed ETL jobs).
- Daily at midnight New York Runs at 5 AM UTC but measures midnight → midnight in the New York time zone.
Handling data delays
Many teams have ETL pipelines that complete several hours after midnight. In these cases, you can configure monitors to delay execution (for example, run at 4 AM but still measure the previous day’s partition). This ensures freshness or volume checks evaluate complete data instead of partially loaded partitions.Advanced configurations
SYNQ supports advanced scheduling behaviors to cover all data-readiness scenarios:- Ignore last partition – Skip the most recent day/hour if data isn’t yet ready (useful for delayed ingestion).