Building an Open Data Lakehouse Using Apache Spark, Apache Iceberg and Dremio

Explore the evolution of the big data landscape and the concept of data lakehouses in this 45-minute SQLBits conference talk. Delve into the development of Open Data Lakehouses, focusing on their implementation, security, governance, and enhancement using Dremio. Learn about key technologies such as Apache Spark and Apache Iceberg, and their roles in building modern data architectures. Gain insights from speaker Mike Flower on topics including SQL 2019, data lake management, database engines, big data analytics, optimization techniques, and platform-agnostic approaches. Discover how these concepts apply to big data and data engineering, data security and governance, and developer-oriented practices in the evolving data landscape.

Building an Open Data Lakehouse using Apache Spark, Apache Iceberg and Dremio