Elastic Heterogeneous Cluster and Heterogeneity-Aware Job Configuration

Explore the intricacies of elastic heterogeneous clusters and heterogeneity-aware job configuration in this 42-minute presentation from ApacheCon 2022. Delve into the internal organization of Apache Daffodil, focusing on its DFDL schema compiler written in Scala using advanced functional programming techniques like Object-Oriented Lazy Attribute Grammars (OOLAG). Discover how Daffodil has evolved to support multiple runtime environments, from Scala for the JVM to a C-code generator producing optimized C-language source code. Gain insights into new features, including the Daffodil VSCode-based data debugger, and understand the implications of elastic heterogeneous clusters on job configuration and performance optimization.

Elastic Heterogeneous Cluster and Heterogeneity Aware Job Configuration Yongqin Xiao, Atam Prakash