Building End-to-End Delta Pipelines on GCP
Offered By: Databricks via YouTube
Course Description
Overview
Explore building end-to-end Delta pipelines on Google Cloud Platform in this 27-minute Databricks video. Learn how Delta addresses traditional data lake challenges and powers production pipelines at scale for Data and AI use cases. Discover the Lake House Architecture and Modern Data Architecture concepts. Follow along with code examples and notebooks to construct a Delta Pipeline using the Bronze-Silver-Gold architecture pattern. See how to consume Delta files using the Big Query Connector. Gain insights into reference architectures, use cases, and demo setups for ingesting reference data and language codes. Understand how Delta enhances data reliability, storage, and query performance for both batch and streaming scenarios, while enabling fast interactive queries for BI and machine learning applications.
Syllabus
Introduction
Traditional Data Lake Challenges
Lake House Architecture
Modern Data Architecture
Reference Architecture
Use Case
Demo Setup
Ingest
Reference Data
Language Codes
Conclusion
Taught by
Databricks
Related Courses
SAP Business Warehouse powered by SAP HANASAP Learning Relational Database Support for Data Warehouses
University of Colorado System via Coursera Data Warehouse Concepts, Design, and Data Integration
University of Colorado System via Coursera Business Intelligence Concepts, Tools, and Applications
University of Colorado System via Coursera Design and Build a Data Warehouse for Business Intelligence Implementation
University of Colorado System via Coursera