YoVDO

Building End-to-End Delta Pipelines on GCP

Offered By: Databricks via YouTube

Tags

Delta Lake Courses Data Warehousing Courses BigQuery Courses Data Engineering Courses Stream Processing Courses Batch Processing Courses Data Pipelines Courses

Course Description

Overview

Explore building end-to-end Delta pipelines on Google Cloud Platform in this 27-minute Databricks video. Learn how Delta addresses traditional data lake challenges and powers production pipelines at scale for Data and AI use cases. Discover the Lake House Architecture and Modern Data Architecture concepts. Follow along with code examples and notebooks to construct a Delta Pipeline using the Bronze-Silver-Gold architecture pattern. See how to consume Delta files using the Big Query Connector. Gain insights into reference architectures, use cases, and demo setups for ingesting reference data and language codes. Understand how Delta enhances data reliability, storage, and query performance for both batch and streaming scenarios, while enabling fast interactive queries for BI and machine learning applications.

Syllabus

Introduction
Traditional Data Lake Challenges
Lake House Architecture
Modern Data Architecture
Reference Architecture
Use Case
Demo Setup
Ingest
Reference Data
Language Codes
Conclusion


Taught by

Databricks

Related Courses

SAP Business Warehouse powered by SAP HANA
SAP Learning
Relational Database Support for Data Warehouses
University of Colorado System via Coursera
Data Warehouse Concepts, Design, and Data Integration
University of Colorado System via Coursera
Business Intelligence Concepts, Tools, and Applications
University of Colorado System via Coursera
Design and Build a Data Warehouse for Business Intelligence Implementation
University of Colorado System via Coursera