YoVDO

Building End-to-End Delta Pipelines on GCP

Offered By: Databricks via YouTube

Tags

Delta Lake Courses Data Warehousing Courses BigQuery Courses Data Engineering Courses Stream Processing Courses Batch Processing Courses Data Pipelines Courses

Course Description

Overview

Explore building end-to-end Delta pipelines on Google Cloud Platform in this 27-minute Databricks video. Learn how Delta addresses traditional data lake challenges and powers production pipelines at scale for Data and AI use cases. Discover the Lake House Architecture and Modern Data Architecture concepts. Follow along with code examples and notebooks to construct a Delta Pipeline using the Bronze-Silver-Gold architecture pattern. See how to consume Delta files using the Big Query Connector. Gain insights into reference architectures, use cases, and demo setups for ingesting reference data and language codes. Understand how Delta enhances data reliability, storage, and query performance for both batch and streaming scenarios, while enabling fast interactive queries for BI and machine learning applications.

Syllabus

Introduction
Traditional Data Lake Challenges
Lake House Architecture
Modern Data Architecture
Reference Architecture
Use Case
Demo Setup
Ingest
Reference Data
Language Codes
Conclusion


Taught by

Databricks

Related Courses

内存数据库管理
openHPI
CS115x: Advanced Apache Spark for Data Science and Data Engineering
University of California, Berkeley via edX
Processing Big Data with Azure Data Lake Analytics
Microsoft via edX
Google Cloud Big Data and Machine Learning Fundamentals en Español
Google Cloud via Coursera
Google Cloud Big Data and Machine Learning Fundamentals 日本語版
Google Cloud via Coursera