Managing 1 Million+ DBs - How Big Data is Used to Run SQL Azure

Explore how Microsoft manages over a million databases in SQL Azure through this conference talk from PASS Data Community Summit. Dive into big data techniques for cloud troubleshooting, telemetry scaling, and data collection strategies. Learn about building batch pipelines, utilizing table and blob storage, and creating dashboard systems. Discover cloud service fundamentals and approaches to petabyte-scale telemetry. Gain insights on near real-time alerting and the potential of machine learning in database management. Understand the challenges and solutions in managing massive-scale database operations in the cloud.

Intro
Talk Motivation
Troubleshooting Models
Cloud Troubleshooting Model
Telemetry Scenarios
Disclosures
Telemetry Scaling - Lessons Learned
What Data To Collect?
Building Batch Pipelines
Table Storage
Blob Storage + SQL Database
Example Dashboard/Report System
Cloud Service Fundamentals
Approach 3 - Petabyte Scale Telemetry
Approach 3 - Details/Limitations
(Near Real-Time) Alerting
Using Machine Learning Option 1: Go get R-it is free