YoVDO

Drastically Reducing Processing Costs with Delta Lake

Offered By: Databricks via YouTube

Tags

Delta Lake Courses Databricks Courses Data Pipelines Courses Star Schema Courses Photons Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore a 34-minute conference talk by Amadeus Principal Data Engineers Generoso Pagano and Mauricio Jost on optimizing data pipelines using Delta Lake and Databricks. Learn how Amadeus, a global travel technology company, transformed raw data into efficient star schemas while meeting customer demands for extensive historical data and high refresh rates at low costs. Discover the tools and methodology used to identify read-and-write amplification issues, and gain insights into essential features like Predictive I/O, Photon, Deletion Vectors, Partition Pruning, and Dynamic File Pruning. Understand how collaboration with Databricks led to significant cost reductions in processing travel industry data. Gain valuable knowledge on implementing state-of-the-art features to optimize your own data pipelines and reduce infrastructure costs.

Syllabus

Drastically Reducing Processing Costs with Delta Lake


Taught by

Databricks

Related Courses

Google Cloud Big Data and Machine Learning Fundamentals en Español
Google Cloud via Coursera
Data Analysis with Python
IBM via Coursera
Intro to TensorFlow 日本語版
Google Cloud via Coursera
TensorFlow on Google Cloud - Français
Google Cloud via Coursera
Freedom of Data with SAP Data Hub
SAP Learning