Breaking Boundaries - TACC as a Unified Cloud-Native Infrastructure for AI and HPC

Explore a groundbreaking conference talk on TACC (Tensor Accelerator Cluster), an innovative AI infrastructure management solution bridging the gap between Kubernetes and Slurm setups. Discover how TACC addresses the challenges of managing large GPU clusters for AI models, offering a unified cloud-native infrastructure for both AI and High-Performance Computing (HPC). Learn about the five-year journey of implementing TACC at Hong Kong University of Science and Technology, supporting over 500 active researchers since 2020. Delve into key aspects such as user experience improvements, resource management strategies, and performance enhancements. Gain insights on the seamless UI for job submissions, multi-tenant allocation using CNCF HAMi and Kueue, and robust distributed infrastructure featuring networked storage and RDMA via CNCF SpiderPool and Fluid. Understand how TACC combines the advantages of Kubernetes and Slurm to create a more efficient and user-friendly environment for AI and HPC workloads.

Breaking Boundaries: TACC as an Unified Cloud-Native Infra for AI + HPC - Peter Pan & Kaiqiang Xu