YoVDO

How Discord Stores Trillions of Messages - Deep Dive

Offered By: Hussein Nasser via YouTube

Tags

Software Development Courses Database Management Courses Database Migration Courses Distributed Databases Courses B-trees Courses Database Engineering Courses Backend Engineering Courses

Course Description

Overview

Dive deep into Discord's engineering journey as they migrate from Cassandra to ScyllaDB to handle trillions of messages. Explore the fundamentals of database engineering, comparing relational and distributed systems. Understand the challenges faced with Cassandra, including hot partitions and garbage collector pauses. Learn about crucial concepts like SnowFlake vs UUID, B+Trees and their interaction with SSDs, and LSM Trees. Discover how Discord rearchitected their backend, implemented data services, and executed the migration. Gain insights into zoned namespaces and walk away with a comprehensive understanding of large-scale message storage solutions in this informative video lecture.

Syllabus

Intro
Relational vs Distributed
The Cassandra Troubles
SnowFlake vs UUID
B+Tree
B+Tree and SSDs
LSM Trees
Hot partitions
Cassandra Garbage Collector Pauses
Changing the Architecture
The Data Services
The Migration
Zoned Named Spaces
Summary


Taught by

Hussein Nasser

Related Courses

Data Structures and Algorithm Design Part II | 数据结构与算法设计(下)
Tsinghua University via edX
Hacking PostgreSQL: Data Access Methods
Ural Federal University via edX
Ordered Data Structures
University of Illinois at Urbana-Champaign via Coursera
I/O-efficient algorithms
EIT Digital via Coursera
Data Structures and Algorithms (III)
Tsinghua University via Coursera