RPC in WhatsApp - Scaling Erlang Infrastructure
Offered By: Code Sync via YouTube
Course Description
Overview
Explore the intricacies of WhatsApp's infrastructure in this 36-minute conference talk from Code BEAM America 2024. Dive into the lifecycle of requests flowing between Erlang services, learning how WhatsApp overcomes limitations to scale their cluster to over 40,000 nodes using Erlang Distribution. Discover the service discovery and routing mechanisms, job dispatching and queueing models, as well as bottlenecks and overload protections. Gain valuable insights on building Erlang infrastructure at scale, covering topics such as scaled clusters, RPC workflow, service discovery, request dispatching, load balancing, and common issues. The presentation concludes with a Q&A session, allowing for deeper exploration of specific aspects of WhatsApp's large-scale Erlang implementation.
Syllabus
Introduction
Scaled Cluster
RPC Workflow
Service Discovery
Request Dispatching
Issues
Load Balancing
Questions
Taught by
Code Sync
Related Courses
Managing Big Data in Clusters and Cloud StorageCloudera via Coursera The Complete Apache Kafka Practical Guide
Udemy Dynamical Systems in Neuroscience
MITCBMM via YouTube Dimensionality Reduction II
MITCBMM via YouTube Optimizing Spark SQL Jobs with Parallel and Asynchronous IO
Databricks via YouTube