Building End-to-End Delta Pipelines on GCP
Offered By: Databricks via YouTube
Course Description
Overview
Explore building end-to-end Delta pipelines on Google Cloud Platform in this 27-minute Databricks video. Learn how Delta addresses traditional data lake challenges and powers production pipelines at scale for Data and AI use cases. Discover the Lake House Architecture and Modern Data Architecture concepts. Follow along with code examples and notebooks to construct a Delta Pipeline using the Bronze-Silver-Gold architecture pattern. See how to consume Delta files using the Big Query Connector. Gain insights into reference architectures, use cases, and demo setups for ingesting reference data and language codes. Understand how Delta enhances data reliability, storage, and query performance for both batch and streaming scenarios, while enabling fast interactive queries for BI and machine learning applications.
Syllabus
Introduction
Traditional Data Lake Challenges
Lake House Architecture
Modern Data Architecture
Reference Architecture
Use Case
Demo Setup
Ingest
Reference Data
Language Codes
Conclusion
Taught by
Databricks
Related Courses
内存数据库管理openHPI CS115x: Advanced Apache Spark for Data Science and Data Engineering
University of California, Berkeley via edX Processing Big Data with Azure Data Lake Analytics
Microsoft via edX Google Cloud Big Data and Machine Learning Fundamentals en Español
Google Cloud via Coursera Google Cloud Big Data and Machine Learning Fundamentals 日本語版
Google Cloud via Coursera