Hunting for New Particles Leveraging Legacy Infrastructure with Kubernetes
Offered By: CNCF [Cloud Native Computing Foundation] via YouTube
Course Description
Overview
Explore how CERN leverages Kubernetes to analyze billions of particle collision events from the Large Hadron Collider while integrating legacy high-throughput computing systems. Learn about the challenges of processing massive datasets in particle physics research and how cloud-native technologies are revolutionizing scientific computing. Discover the implementation of complex physics analysis workflows using Kubernetes, the role of software containers in open science, and the innovative use of the HTCondor Operator to bridge modern and traditional computing infrastructures. Gain insights into the intricate world of high-energy physics computing, the importance of legacy systems, and the future of scientific data processing in the cloud era.
Syllabus
Intro
The Large Hadron Collider
High Energy Physics
Legacy Infrastructure
Grid Sites
Challenges
Cluster
Workflow
Example Workflow
The Problem
The HD Condor Operator
The HD Condor Implementation
Running HD Condor jobs with Argo
Conclusion
Questions
Storage
Workflows
Other tools
Other questions
Improvements
Taught by
CNCF [Cloud Native Computing Foundation]
Related Courses
OpenKnowledge: Changing the global course of learningStanford University via Stanford OpenEdx Improving your statistical inferences
Eindhoven University of Technology via Coursera Transparent and Open Social Science Research
University of California, Berkeley via FutureLearn Reproducible Templates for Analysis and Dissemination
Emory University via Coursera Open Science: Sharing Your Research with the World
Delft University of Technology via edX