Apache Flink Stream Batch Adaptive Shuffle - Latest Progress and Future Plans
Offered By: The ASF via YouTube
Course Description
Overview
Explore the latest advancements in Apache Flink's Shuffle architecture in this 30-minute conference talk from Flink Forward Asia 2022. Presented by Song Xintong, Apache Flink PMC Member and Alibaba Cloud senior technical expert, and Tan Yuxin, senior development engineer at Alibaba Cloud, delve into the Flink Shuffle 3.0 architecture. Learn about its core features of cloud-native compatibility, stream-batch fusion, and adaptive capabilities. Discover how this new architecture enhances resource orchestration and isolation in cloud environments, combines the strengths of traditional streaming and batch Shuffle technologies, and offers adaptive adjustments based on runtime resources and load. Gain insights into the progress made in Flink version 1.18 and future plans for this innovative Shuffle architecture.
Syllabus
Apache Flink Stream Batch Adaptive Shuffle
Taught by
The ASF
Related Courses
Web Intelligence and Big DataIndian Institute of Technology Delhi via Coursera Big Data for Better Performance
Open2Study Big Data and Education
Columbia University via edX Big Data Analytics in Healthcare
Georgia Institute of Technology via Udacity Data Mining with Weka
University of Waikato via Independent