Slowly Changing Dimensions Type 2 in Data Lakes - Tech Chat
Offered By: Databricks via YouTube
Course Description
Overview
Explore the concept of Slowly Changing Dimensions (SCD) Type 2 in this informative tech talk from Databricks. Dive into the application of this popular online analytics processing (OLAP) fundamental within data lakes, focusing on how Delta Lake's reliability has revitalized data warehousing concepts. Learn how Type 2 SCD enables tracking both historical and current data over time, using a climbing eCommerce site's market segmentation as a practical example. Gain insights from Douglas Moore, a Solution Architect with over 25 years of data experience, as he discusses the implementation of SCD Type 2 in modern data architectures. Discover the importance of change data capture, explore data exploration techniques, and understand the differences between bronze and gold data tiers. Witness a live demo showcasing the practical application of these concepts through visualizations and queries.
Syllabus
Introduction
Upcoming Online Events
Spark Plus AI Summit
Introducing Douglas Moore
Setting Context
Context Setting
Data Exploration
Customer Dimension
Questions
Customer Perfect
Another Question
Bronze vs Gold
Change Sets
Visualization
Demo
Query
Merge
Taught by
Databricks
Related Courses
Distributed Computing with Spark SQLUniversity of California, Davis via Coursera Apache Spark (TM) SQL for Data Analysts
Databricks via Coursera Building Your First ETL Pipeline Using Azure Databricks
Pluralsight Implement a data lakehouse analytics solution with Azure Databricks
Microsoft via Microsoft Learn Perform data science with Azure Databricks
Microsoft via Microsoft Learn