Spark, Cloud, DBT, Data Warehouses Etc. - Navdeep Kaur

Explore the evolving landscape of Data Engineering in this insightful 34-minute video featuring Navdeep Kaur. Delve into the current trends and the shift towards a new data stack, uncovering the tech stack favored by most companies. Understand the driving forces behind the need for change and how the industry is transitioning towards data warehouses and delta lakes. Learn about modern data engineering, traditional warehouse challenges, data lakes and their limitations, and the emergence of data lakehouses. Discover the ELT approach, modern data stack, and the movement towards datamesh. Gain valuable insights into whether the industry is ready for lakehouses and how these changes impact data science professionals.

- Introductions
- Modern Data Engineering
- Traditional Warehouses Challenges
- Data Lake
- Challenges with Data Lakes
- Best of Both Worlds: Data Lakehouse
- Are We Ready For Lakehouses?
- ELT Approach
- Modern Data Stack
- Moving Towards Datamesh