Design of a Composable Infrastructure Platform

Explore the design of a composable infrastructure platform in this 29-minute conference talk from USENIX Vault '19. Dive into the concept of dynamically creating secure application clusters from disaggregated compute, storage, and networking resources. Learn about the challenges of availability, durability, scalability, performance, and correctness in implementing such a solution. Discover how this approach targets widely deployed data analytics and NoSQL database applications, scaling to hundreds or thousands of compute nodes with tens of thousands of disks per application cluster. Follow the five-part presentation, covering the user perspective of creating virtual clusters, platform requirements, state machine design for orchestration, implementation of Linux networking and storage subsystems, and key failure scenarios with recovery mechanisms. Gain insights into the use of open-source components for achieving scale, availability, and security in composable infrastructure platforms.

Vault '19 - Design of a Composable Infrastructure Platform