YoVDO

Data Domain Cloud Tier - Backup Here, Backup There, Deduplicated Everywhere!

Offered By: USENIX via YouTube

Tags

USENIX Annual Technical Conference Courses Data Migration Courses System Architecture Courses Storage Optimization Courses

Course Description

Overview

Explore a conference talk detailing Data Domain's cloud tier capability for its on-premises storage appliance, focusing on key innovations that support essential customer interactions. Learn about architectural changes and new algorithms addressing the impact of deduplicated storage and cloud object storage challenges. Discover how customers estimate space savings, transfer files to and from the cloud, and manage file deletion in the cloud tier. Gain insights into real-world deployments, including examples of customers moving over 20PB of logical data to the cloud tier and achieving compression factors of 40× or more, resulting in significant cost savings. Delve into topics such as file representation, active and cloud tier architecture, deduplication system challenges, physical scanning, efficient data seeding and incremental transfers, and dead data cleaning in the cloud tier. Examine the evaluation methodology, field analysis, and summary of results from this USENIX ATC '19 presentation.

Syllabus

Intro
Data Domain Appliance
Data Domain Cloud Tier
File Representation in Data Domain Filesystem
Active Tier and Cloud Tier Architecture
Challenges in Deduplication System
Requirements for Cloud Tier
Physical Scanning
How much space will be freed if we move data to cloud tier?
How can we seed data efficiently to the cloud tier?
How can we move incremental data to cloud tier?
How can we efficiently clean dead data on cloud tier?
Evaluation Methodology
Field Analysis
Summary of Field Evaluation Results
Internal Evaluation !
Conclusion
THE ADVANCED COMPUTING SYSTEMS ASSOCIATION


Taught by

USENIX

Related Courses

Amazon DynamoDB - A Scalable, Predictably Performant, and Fully Managed NoSQL Database Service
USENIX via YouTube
Faasm - Lightweight Isolation for Efficient Stateful Serverless Computing
USENIX via YouTube
AC-Key - Adaptive Caching for LSM-based Key-Value Stores
USENIX via YouTube
The Future of the Past - Challenges in Archival Storage
USENIX via YouTube
A Decentralized Blockchain with High Throughput and Fast Confirmation
USENIX via YouTube