YoVDO

DC-Store - Eliminating Noisy Neighbor Containers Using Deterministic I/O Performance and Resource Isolation

Offered By: USENIX via YouTube

Tags

FAST (File and Storage Technologies) Courses Containerization Courses

Course Description

Overview

Explore a storage framework designed to provide deterministic I/O performance in multi-container environments. Learn about DC-store, which implements multiple NVM sets on a shared storage pool to eliminate internal resource conflicts and isolate noisy neighbor containers. Discover how this innovative approach combines hardware-level design with software support to enhance Linux kernel functionality. Examine the prototype implementation and evaluation results, which demonstrate a 31% reduction in average execution time for containerized data-intensive applications compared to baseline systems. Gain insights into the challenges of conventional storage sharing, the impact of page frame reclaiming, and the benefits of physical separation in SSD volumes. Delve into the technical details of container creation, control group settings, and system call procedures for improved resource management.

Syllabus

Intro
High-level Summary of Talk
Facebook: Representative Example of Multi-Container
Analogy of Facebook Scenario
Conventional Storage Sharing: Logical Separation
Test Target: Container A's User Experience
Divided SSD: Do Not Share Internal Resources
Hardware Prototyping
Soundproof test of Physically Separated Volume
Limitation of Conventional Noise Elimination
Page Frame Reclaiming: Representative Example
Background: How Page Frame Reclaiming Works
Public: One Case of Page Frame Reclaiming
Private: Pinning Metadata Destination
Sharable/Pinnable Property of Swap Area
Enabling Swap Area Property (Pinnable)
Container Creation with Pinned Info.
Define New Control Group (Cgroup) Setting File
Background: Container Creation Process
Background: Syscall for Container Data Structure
Background: Procedure of Page Frame Reclaiming
Pinned Info Aware Page Frame Reclaiming
Experiment Setup: Software Modification
Experiment Setup: Application Preparation
Experiment Setup: Real Workload Selection
Evaluation: Overall Performance
Result: Time Series Analysis
Evaluation: 1/0 Tacker Performance
Result: Execution Time Comparison


Taught by

USENIX

Related Courses

AWS Developer Tools Deep Dive
A Cloud Guru
Essential Container Concepts
A Cloud Guru
Google Cloud CI/CD Pipelines (GCP DevOps Engineer Track Part 3)
A Cloud Guru
Google Kubernetes Engine (GKE): Beginner to Pro
A Cloud Guru
LPI DevOps Tools Engineer Certification
A Cloud Guru