The Programming Challenges of Climate Data Analysis

Explore the complex world of climate data analysis in this 12-minute conference talk from ACM SIGPLAN's PROPL'24. Dive into the sophisticated tools and methodologies required for analyzing vast datasets generated by climate models, satellite data, and observational records. Learn about the multi-phase pipelines and workflows involved in climate data analysis, including international planning, data acquisition from heterogeneous sources, and global collaborations for evaluation and archival. Discover state-of-the-art methods used in data analysis workflows for Global Climate Models, with a focus on the Climate Model Intercomparison Project (CMIP) and the Earth System Grid Federation (ESGF). Gain insights into topics relevant to climate data analysis tool developers, including an overview of Python ecosystem libraries for multidimensional data analysis and storage, a formal definition of climate data within the relational data model, and an exploration of storage systems (HPC and cloud) used by the climate community. Presented by Ezequiel Cimadevilla, this talk offers a comprehensive update on the programming challenges faced in the critical field of climate data analysis.

[PROPL'24] The programming challenges of climate data analysis