Data Utility Architecture - A Lakehouse Serving the Whole Enterprise
Offered By: Databricks via YouTube
Course Description
Overview
Explore a 36-minute conference talk that introduces the Data Utility Architecture (DUA), a revolutionary approach to enterprise data management. Learn how DUA, powered by Lakehouse and streaming technologies, unifies operational and analytical data planes, treating data as a commodity and pipelines as a utility serving the entire enterprise. Discover how this architecture breaks down traditional barriers, ingesting, transforming, and delivering data on demand for any purpose. Understand how DUA simplifies enterprise data architecture by handling all data uniformly while addressing specific consumer needs with appropriate Service Level Agreements (SLAs), models, and storage. Gain insights from PwC Canada's Tax DataOps team's production experience, exploring the use of tools like Spark Structured Streaming, Delta tables, and Delta Sharing. Delve into the evolution from Zhamak Dehghani's Data Mesh concept to this innovative approach that reimagines enterprise architecture as a utility.
Syllabus
Data Utility Architecture: A Lakehouse Serving the Whole Enterprise
Taught by
Databricks
Related Courses
Web sémantique et Web de donnéesInria (French Institute for Research in Computer Science and Automation) via France Université Numerique Linked Data Engineering
openHPI Implementing ETL with SQL Server Integration Services
Microsoft via edX Advanced Manufacturing Enterprise
University at Buffalo via Coursera Big Data Services: Capstone Project
Yandex via Coursera