Best Big Data Architecture for You - Comparing Modern Approaches

Explore the evolution and future of big data architectures in this 44-minute conference talk from GOTO Amsterdam 2024. Delve into the history of data architectures, from early data warehouses to modern cloud-based platforms. Compare competing patterns like Data Mesh, Data Lakehouse, Data Fabric, and Data Vault, examining their differences and implementation challenges. Learn about the requirements for effective big data architectures and gain insights into their future development. Discover the modern data stack, understand the concept of data as a product, and grasp key technologies like Apache Spark. Conclude with four essential takeaways to guide your approach to big data architecture selection and implementation.

Intro
Agenda
Why big data & big data architecture BDA?
What is a BDA & its requirements?
History of data architectures
Different BDAs
Moder data stack
Data Lakehouse
Data Mesh
Future of BDA
Summary: 4 things to remember
Outro