YoVDO

Zero-Change Object Transmission for Distributed Big Data Analytics

Offered By: USENIX via YouTube

Tags

USENIX Annual Technical Conference Courses Performance Evaluation Courses

Course Description

Overview

Explore a conference talk on Zero-Change Object Transmission (ZCOT), a novel approach to enhance distributed big data analytics performance. Delve into the challenges of data exchange in high-level languages like Java and Scala, and discover how ZCOT enables direct object copying between Java Virtual Machines without transformations. Learn about the benefits of ZCOT, including minimal integration efforts with existing applications and potential for deduplication. Examine the experimental results showcasing ZCOT's ability to significantly improve data exchange efficiency and boost application performance by up to 23.6% in state-of-the-art data analytics frameworks. Gain insights into the workflow of ZCOT, space construction techniques, compatibility with applications, distributed memory management, and RPC interfaces.

Syllabus

Intro
Distributed Big-data Analytics
Workflow of Big-data Processing
Costly Inter-JVM Communications
Existing S/D Optimizations
How to Achieve This?
Challenges for ZCOT
Space Construction: DCDS
Compatibility with Applications
Distributed Memory Management
RPC Interfaces
The Workflow of ZCOT
Experimental Setup
Mircobenchmark
Flink Performance
Conclusion


Taught by

USENIX

Related Courses

Amazon DynamoDB - A Scalable, Predictably Performant, and Fully Managed NoSQL Database Service
USENIX via YouTube
Faasm - Lightweight Isolation for Efficient Stateful Serverless Computing
USENIX via YouTube
AC-Key - Adaptive Caching for LSM-based Key-Value Stores
USENIX via YouTube
The Future of the Past - Challenges in Archival Storage
USENIX via YouTube
A Decentralized Blockchain with High Throughput and Fast Confirmation
USENIX via YouTube