YoVDO

Data Utility Architecture - A Lakehouse Serving the Whole Enterprise

Offered By: Databricks via YouTube

Tags

Data Integration Courses Data Pipelines Courses Spark Structured Streaming Courses DataOps Courses Data Mesh Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore a 36-minute conference talk that introduces the Data Utility Architecture (DUA), a revolutionary approach to enterprise data management. Learn how DUA, powered by Lakehouse and streaming technologies, unifies operational and analytical data planes, treating data as a commodity and pipelines as a utility serving the entire enterprise. Discover how this architecture breaks down traditional barriers, ingesting, transforming, and delivering data on demand for any purpose. Understand how DUA simplifies enterprise data architecture by handling all data uniformly while addressing specific consumer needs with appropriate Service Level Agreements (SLAs), models, and storage. Gain insights from PwC Canada's Tax DataOps team's production experience, exploring the use of tools like Spark Structured Streaming, Delta tables, and Delta Sharing. Delve into the evolution from Zhamak Dehghani's Data Mesh concept to this innovative approach that reimagines enterprise architecture as a utility.

Syllabus

Data Utility Architecture: A Lakehouse Serving the Whole Enterprise


Taught by

Databricks

Related Courses

Data Mesh - A Modern Decentralized Data Management Concept
Udemy
Building a Data Mesh - Strategies and Best Practices
Open Data Science via YouTube
Building a Petabyte-Scale Cybersecurity Data Mesh in Azure with Delta Lake - HSBC Case Study
Databricks via YouTube
Data Lakehouse and Data Mesh - Two Sides of the Same Coin
Databricks via YouTube
Solving Business Problems with Data - Delivering Value Through Use Case Deconstruction
Databricks via YouTube