A Short Summary of the Last Decades of Data Management - GOTO 2024

Embark on a comprehensive journey through the evolution of data management in this 50-minute conference talk from GOTO Amsterdam 2024. Explore the transformation from monolithic vendor systems of the 90s to the open-source engines and cloud computing resources of today. Delve into key trends, including the rise and fall of various specialized systems, from semi-structured data support to vector databases. Gain insights into the trillion-dollar data industry's continuous quest for innovative data management solutions. Examine topics such as DuckDB, SQL vs. NoSQL debates, Hadoop, MongoDB, Cassandra, Apache Spark, and the resurgence of relational databases. Analyze the impact of these developments on modern data management practices and contemplate the future of big data.

Intro
DuckDB
Ancient history
One size fits all?
No SQL!
Hadoop
Hive
MongoDB
Cassandra
Apache Spark
Tables, SQL, ACID
New SQL!
Relational eats everything
What refuses to be eaten?
Big data is dead?
Summary
Outro