Revolutionizing Scientific Simulations with Argo Workflows
Offered By: CNCF [Cloud Native Computing Foundation] via YouTube
Course Description
Overview
Explore a conference talk on revolutionizing scientific simulations using Argo Workflows, presented by ShaungKun Tian and YaShi Su from Alibaba Cloud. Discover how DP Technology leverages Argo Workflows to orchestrate complex scientific simulations, resulting in a 100% productivity improvement. Learn about the challenges of managing large-scale scientific tasks and the solutions implemented, including best practices for handling workflows with thousands of tasks, implementing efficient retry mechanisms, and optimizing runtime through memoization. Gain insights into integrating with HPC systems and the development of DFlow, an open-source Python SDK for seamless orchestration of scientific simulations with Argo Workflows. Understand the contributions made to the Argo community to enhance functionality and improve reliability in scientific computing workflows.
Syllabus
Revolutionizing Scientific Simulations with Argo Workflows - ShaungKun Tian & YaShi Su
Taught by
CNCF [Cloud Native Computing Foundation]
Related Courses
Argo Workflows on Kubernetes - Core ConceptsUdemy Managing ML Models at Scale - Intuit’s ML Platform
USENIX via YouTube Automating Cloud-native Spark Jobs with Argo Workflows
Linux Foundation via YouTube Bringing ML Workflows to Heterogeneous Cloud Native Machine Learning Platforms Using Intermediate Representation
Linux Foundation via YouTube Multi-branch Pipeline with Argo Workflows and CI/CD Debugging
CNCF [Cloud Native Computing Foundation] via YouTube