Architect's Open-Source Guide for Data Mesh Architecture
Offered By: Databricks via YouTube
Course Description
Overview
Explore the innovative concept of Data Mesh architecture in this 31-minute video from Databricks. Gain insights into core Data Mesh principles, their benefits, and ideal implementation scenarios. Discover common challenges in implementing Data Mesh systems and learn about the crucial role of open-source projects, particularly Apache Spark, in standardized infrastructure platform implementation. Examine the landscape of useful data engineering open-source projects for various areas of a Data Mesh system, complete with an architectural example. Understand the cultural, tooling, and mindset shifts required to make Data Mesh more accessible for engineers in the industry. Aimed at architects, decision-makers, data engineers, and system designers, this session provides a comprehensive understanding of Data Mesh architecture benefits, challenges, and the role of open-source projects in real-world implementations.
Syllabus
Introduction
Data Mesh vs Data Warehouse
Challenges in an Organization
Data Products
Governance Standards
Open Source Tools
Implementation Challenges
Technology Considerations
Data Mesh Friendly Technologies
Open Source Options
Taught by
Databricks
Related Courses
CS115x: Advanced Apache Spark for Data Science and Data EngineeringUniversity of California, Berkeley via edX Big Data Analytics
University of Adelaide via edX Big Data Essentials: HDFS, MapReduce and Spark RDD
Yandex via Coursera Big Data Analysis: Hive, Spark SQL, DataFrames and GraphFrames
Yandex via Coursera Introduction to Apache Spark and AWS
University of London International Programmes via Coursera