YoVDO

Cache for Cash - Speeding Up Production with Kafka and MySQL binlog

Offered By: USENIX via YouTube

Tags

SREcon Courses Performance Improvement Courses

Course Description

Overview

Discover how to serve up-to-date information on a high-scale production system in this 28-minute conference talk from SREcon21. Learn about a innovative approach to in-memory caching that balances data freshness and load using Kafka and MySQL binlog. Explore the journey of creating a "fast track" system that resulted in significant performance and yield improvements across thousands of services. Gain insights into maintaining fast response times while handling massive loads of 500K HTTP requests per second. Understand the constraints of successful production systems and how to overcome them using advanced caching techniques. Delve into the benefits of using Kafka for data distribution and learn how to inject data directly into caches for blazing fast information updates.

Syllabus

Intro
Cache for Cash Speeding up production with Kafka and Mysql binlog
3 Constraints of a Successful Production
Fast Response time
Traditional cache layers
Fresh Data = higher yield
Lower load = Lower cost
Use Kafka for data distribution
Inject Data to Caches


Taught by

USENIX

Related Courses

How to Not Destroy Your Production Kubernetes Clusters
USENIX via YouTube
SRE and ML - Why It Matters
USENIX via YouTube
Knowledge and Power - A Sociotechnical Systems Discussion on the Future of SRE
USENIX via YouTube
Tracing Bare Metal with OpenTelemetry
USENIX via YouTube
Improving How We Observe Our Observability Data - Techniques for SREs
USENIX via YouTube