Delight - Improved Apache Spark UI for Performance Troubleshooting

Offered By: Databricks via YouTube

Course Description

Overview

Explore a 21-minute conference talk introducing Delight, a free and cross-platform monitoring dashboard for Apache Spark. Learn how this tool complements the Spark UI by displaying system metrics and Spark information on a unified timeline. Discover how Delight can be installed using an open-source Spark agent and works with any Spark platform. Follow along as the co-founders of Data Mechanics demonstrate real-world performance troubleshooting sessions, showcasing how Delight and Spark UI can jointly identify application bottlenecks. Gain insights into making data engineering pipelines more cost-effective and stable. The talk covers Delight's vision, its functionality, and future developments in Apache Spark monitoring.

Syllabus

Introduction
Delight Data Mechanics
Delight Vision
How Delight Works
Whats Next

Taught by

Databricks

Related Courses

CS115x: Advanced Apache Spark for Data Science and Data Engineering
University of California, Berkeley via edX Big Data Analytics
University of Adelaide via edX Big Data Essentials: HDFS, MapReduce and Spark RDD
Yandex via Coursera Big Data Analysis: Hive, Spark SQL, DataFrames and GraphFrames
Yandex via Coursera Introduction to Apache Spark and AWS
University of London International Programmes via Coursera