YoVDO

Scheduling Framework: Batch Extensions with Apache YuniKorn

Offered By: CNCF [Cloud Native Computing Foundation] via YouTube

Tags

Apache Spark Courses Data Processing Courses Batch Processing Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore batch extensions for Kubernetes scheduling using Apache YuniKorn in this informative conference talk. Delve into the challenges of running batch and data processing workloads on Kubernetes, and discover how Apache YuniKorn extends the scheduler to address these issues. Learn about job-aware preemption, gang scheduling, and queueing with quota enforcement while scheduling. Understand how these opt-in features can be used alongside existing default functionality to improve flexibility and efficiency in handling diverse workload types, including Apache Spark jobs. Gain insights into managing dynamic job requirements, handling pod creation on the fly, and mitigating issues related to quota enforcement and management pod preemption.

Syllabus

Scheduling Framework: Batch Extensions with Apache YuniKorn - Wilfred Spiegelenburg & Peter Bacsko


Taught by

CNCF [Cloud Native Computing Foundation]

Related Courses

CS115x: Advanced Apache Spark for Data Science and Data Engineering
University of California, Berkeley via edX Big Data Analytics
University of Adelaide via edX Big Data Essentials: HDFS, MapReduce and Spark RDD
Yandex via Coursera Big Data Analysis: Hive, Spark SQL, DataFrames and GraphFrames
Yandex via Coursera Introduction to Apache Spark and AWS
University of London International Programmes via Coursera