Duplicates

Overview

Sifflet Field Duplicates Monitor Template is a field-level validation monitor. It checks for duplicate values in the monitored field and reports the number of occurrences where duplicates are found.

As Code

Monitor Kind: FieldDuplicates
This monitor is used to detect and report duplicate values in a specified field.

field:

parameters:
  kind: FieldDuplicates
  field: CUSTOMER_ID

Filtering and grouping

Field duplicates Monitors allow for filtering and grouping parameters.

parameters:
  kind: FieldDuplicates
  field: CUSTOMER_ID
  whereStatement: NOT invalid
  groupBy:
    field: REGION

Time Window (Beta)

📘

Beta

Field duplicates Monitors now allow time window parameters.

Threshold Settings (Beta)

📘

Beta

Field duplicates Monitors now allow threshold configuration.