The Modern Data Engineer Part 6: Hard Deletes and the Ghost Row Problem
Incremental pipelines built on updated_at watermarks cannot detect hard deletes. The result is a ghost row in your SCD Type 2 model and quietly wrong analytics downstream.
Founding Partner at Xyntrel
Precision Data Engineering
You may not have guessed it, my name is Bram. One of the things I do is architect data platforms and share opinionated takes on how they should actually work. Here you'll find real insights for real problems, not the usual vendor narrative. Whether you're scaling platforms, making strategic decisions, or questioning your current approach, there's something here worth your time. Because data engineering is a craft.
Core Competencies
Architecture
Building scalable foundations using Cloud Native principles and modern data stacks.
Engineering
Custom pipeline development and high-throughput stream processing systems.
Strategy & Intelligence
Bridging the gap between raw data and business decisions through governance and AI readiness.
Databricks
Python
dbt
Latest Insights
An opinionated blog designed to challenge decision makers, inspire data professionals, and spark meaningful discussions on the future of data engineering.
SAFe is not Agile. It actively makes your work worse.
SAFe wraps agile vocabulary around a plan-driven framework and sells the result as scaled agility. What it actually scales is the appearance of agility, not the substance. For data teams, the damage is structural and compounding.
The Modern Data Engineer Part 5: Governance Automation, Not Governance Theater
Governance only scales when metadata is produced by delivery workflows, not manual stewardship.
Enterprise Scale Data Engineering
For consulting inquiries or architectural engagements, please visit us at Xyntrel.