Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Selectively Overwrite Data With Delta Lake's Dynamic Insert Overwrite

Databricks via YouTube

Overview

Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Learn about Delta Lake's Dynamic Insert Overwrite feature in this 16-minute lightning talk that demonstrates how to selectively overwrite specific rows without requiring full-table rewrites. Discover the functionality and mechanics of this important capability that enables fine-grained data updates, making it essential for DBT-Databricks incremental models, ETL workloads, and Slowly Changing Dimension (SCD) Type 2 implementations. Explore key use cases where Dynamic Insert Overwrite optimizes performance and reduces costs by processing only new or updated records rather than entire datasets. Gain practical insights and best practices for implementing this feature effectively on Databricks platforms, including guidance for leveraging it on cutting-edge Serverless SQL Warehouses. Understand how this feature enhances data transformation efficiency and supports modern data engineering workflows through targeted data updates.

Syllabus

Selectively Overwrite Data With Delta Lake’s Dynamic Insert Overwrite

Taught by

Databricks

Reviews

Start your review of Selectively Overwrite Data With Delta Lake's Dynamic Insert Overwrite

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.