Scaling Monitoring at Databricks - From Prometheus to M3

Offered By: CNCF [Cloud Native Computing Foundation] via YouTube

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!

Explore the journey of scaling monitoring infrastructure at Databricks, transitioning from Prometheus to M3. Learn about the initial architecture, M3 setup process, migration challenges, and valuable lessons learned. Gain insights into memory usage optimization, internal dashboard development, and strategies for handling upgrades, updates, and metric spikes. Discover capacity planning techniques and future plans for monitoring at Databricks. This comprehensive talk provides a deep dive into the complexities of large-scale monitoring systems and offers practical solutions for similar scaling challenges.

Syllabus

Intro
Monitoring before M3
Initial Architecture
M3 Setup
Migration
Lessons Learned
Memory Usage
Internal Dashboard
Upgrades and Updates
Metric Spikes
Capacity
Future plans
Conclusion

Taught by

CNCF [Cloud Native Computing Foundation]

Related Courses

Introduction to Operations Management
Wharton School of the University of Pennsylvania via Coursera Master Control in Supply Chain Management and Logistics
Chalmers University of Technology via edX Supply Chains for Manufacturing: Capacity Analytics
Massachusetts Institute of Technology via edX On Premises Capacity Upgrade and Monitoring with Google Cloud's Apigee API Platform
Google Cloud via Coursera Operations and Supply Chain Management
Indian Institute of Technology Madras via Swayam