YoVDO

RocketMQ Million Queue Capability Support - RocksDB KV Storage

Offered By: The ASF via YouTube

Tags

Distributed Systems Courses Scalability Courses Message Queues Courses RocksDB Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the implementation of RocketMQ's million queue capability support using RocksDB KV storage in this 29-minute conference talk. Delve into the existing storage architecture challenges faced by RocketMQ, including high CPU pressure from persistent serialization and CRC32 computing, as well as performance bottlenecks in consumeQueue index implementation. Learn how the introduction of RocksDB KV storage addresses these issues by leveraging WAL and memtable for metadata writing, and utilizing LSM tree to optimize random read/write operations for small files. Gain insights from Zhao Fujian, a senior development engineer at Alibaba, as he shares his expertise on enhancing RocketMQ's scalability and performance for million-queue scenarios.

Syllabus

Rocketmq Million Queue Capability Support - Rocksdb Kv Storage


Taught by

The ASF

Related Courses

Advanced Operating Systems
Georgia Institute of Technology via Udacity High Performance Computing
Georgia Institute of Technology via Udacity GT - Refresher - Advanced OS
Georgia Institute of Technology via Udacity Distributed Machine Learning with Apache Spark
University of California, Berkeley via edX CS125x: Advanced Distributed Machine Learning with Apache Spark
University of California, Berkeley via edX