YoVDO

Diving into Delta Lake: How DELETE, UPDATE, and MERGE Work - Part 3

Offered By: Databricks via YouTube

Tags

Delta Lake Courses Big Data Courses Data Management Courses Data Engineering Courses

Course Description

Overview

Dive deep into the inner workings of Delta Lake's DELETE, UPDATE, and MERGE operations in this technical talk. Explore how commits, snapshot isolation, and partition and file changes occur during these operations and structured streaming. Learn about the Delta Lake Transaction Log, understand the fundamentals and actions performed when executing DELETE, UPDATE, and MERGE tasks, and discover techniques for improving performance. Gain insights into extended MERGE syntax, streaming aggregates, and GDPR compliance. Examine Delta Lake releases, roadmap, and connectors, and understand how various users leverage Delta Lake in their data workflows.

Syllabus

Intro
Delta Lake - 1 slide intro
Outline
Update - Under the hood
Update - Improving Performance
Merge - Extended syntax
Merge - Under the hood
Merge - Improving Performance
Streaming aggregates
GDPR - Simple way
Apply change data with delete
Delta Lake Releases and Roadmap
Delta Lake Connectors
Users of Delta Lake


Taught by

Databricks

Related Courses

Distributed Computing with Spark SQL
University of California, Davis via Coursera
Apache Spark (TM) SQL for Data Analysts
Databricks via Coursera
Building Your First ETL Pipeline Using Azure Databricks
Pluralsight
Implement a data lakehouse analytics solution with Azure Databricks
Microsoft via Microsoft Learn
Perform data science with Azure Databricks
Microsoft via Microsoft Learn