What Would You Do With 10^6 Cores? High Performance Computing in the AWS Cloud

Explore high-performance computing (HPC) in the AWS cloud in this 39-minute Devoxx conference talk. Discover technical innovations enabling cloud-based HPC, including custom-built Intel processors, low-energy ARM processors in server-class machines, and purpose-built networking that bypasses TCP/IP for ultra-low latency. Learn about open-source software for spinning up large-scale HPC clusters in the cloud. Delve into topics such as brain imaging, compute storage networking, various instance types (GPU, CPU, AMD, ARM), inferential networking, Lustre file systems, and AWS Parallel Cluster. Gain insights into configuring, creating, and testing HPC clusters, and find out if running 1,000,000 cores in the cloud is achievable or just marketing hype.

Introduction
Frank Munz
Brain Imaging
High Performance Computing
Cloud Computing
HPC vs Cloud
Compute Storage Networking
Instance Types
GPU Instance Types
CPU Instance Types
AMD Store
ARM Instances
Inferential
Networking
Lustre
AWS FX Lustre
AWS FX File System
Parallel Cluster
What is Parallel Cluster
Testing
Configuration
Create Cluster
Check Cluster Queue
We choose to go to the moon
Brain images
The conclusion
Contact details
Output