Slowly Changing Dimensions Type 2 in Data Lakes - Tech Chat
Offered By: Databricks via YouTube
Course Description
Overview
Explore the concept of Slowly Changing Dimensions (SCD) Type 2 in this informative tech talk from Databricks. Dive into the application of this popular online analytics processing (OLAP) fundamental within data lakes, focusing on how Delta Lake's reliability has revitalized data warehousing concepts. Learn how Type 2 SCD enables tracking both historical and current data over time, using a climbing eCommerce site's market segmentation as a practical example. Gain insights from Douglas Moore, a Solution Architect with over 25 years of data experience, as he discusses the implementation of SCD Type 2 in modern data architectures. Discover the importance of change data capture, explore data exploration techniques, and understand the differences between bronze and gold data tiers. Witness a live demo showcasing the practical application of these concepts through visualizations and queries.
Syllabus
Introduction
Upcoming Online Events
Spark Plus AI Summit
Introducing Douglas Moore
Setting Context
Context Setting
Data Exploration
Customer Dimension
Questions
Customer Perfect
Another Question
Bronze vs Gold
Change Sets
Visualization
Demo
Query
Merge
Taught by
Databricks
Related Courses
Data Lakes for Big DataEdCast Distributed Computing with Spark SQL
University of California, Davis via Coursera Modernizing Data Lakes and Data Warehouses with Google Cloud
Google Cloud via Coursera Data Engineering with AWS
Udacity Preparing for Google Cloud Certification: Cloud Data Engineer
Google Cloud via Coursera