[Solved] This incremental model SQL:SELECT * FROM source WHERE event_date > (SELECT MAX(event_date) FROM target)causes missing late-arriving data updates. Why? | dbt

dbt - Incremental Models

This incremental model SQL:

SELECT * FROM source WHERE event_date > (SELECT MAX(event_date) FROM target)

causes missing late-arriving data updates. Why?

AIt causes syntax error due to subquery

BIt excludes late data with event_date less than max date in target

CIt duplicates all records in target

DIt updates all records regardless of date

Step-by-Step Solution

Solution:

Step 1: Analyze filter condition
The filter only selects rows with event_date greater than max in target.
Step 2: Understand late data effect
Late data with older event_date is excluded and never updated.
Final Answer:
It excludes late data with event_date less than max date in target -> Option B
Quick Check:
Filter excludes late data = It excludes late data with event_date less than max date in target [OK]

Quick Trick: Filter by max date excludes late-arriving data [OK]

Common Mistakes:

MISTAKES

Master "Incremental Models" in dbt

9 interactive learning modes - each teaches the same concept differently

More dbt Quizzes

This incremental model SQL: