Tales of Data Architecture Evolution

Explore the evolution of data architecture in this conference talk from NDC Oslo 2023. Delve into the complexities of data engineering and its growing importance in large-scale system architectures. Move beyond buzzwords to understand the fundamental reasons behind concepts like Data Warehouse, Data Lake, and Data Mesh. Learn how to approach the design of modern analytical data infrastructure, evolve existing systems, and gain insights into the future of data platforms. Discover key topics including microservices, real-time streaming, Lambda architecture, data management governance, and the emerging Data Mesh paradigm. Gain valuable knowledge to navigate the path towards optimal data architecture in today's rapidly changing technological landscape.

Introduction
Data Architecture
Evolution
System Architecture
Microservices
The Next Paradigm Shift
Data Lake
Data Loss
Data Latency
RealTime Streaming
Lambda Architecture
Optimize
Big enough
Modern view
Data without information
Data management governance
Data Mesh
The Future