Democratizing Metrics at Airbnb - Minerva Platform Architecture and Future Plans

Explore a 29-minute conference talk on data democratization and the development of Minerva, Airbnb's centralized metrics platform. Discover how Airbnb addressed challenges in ensuring data consistency at scale while enabling self-service access for users with varying levels of expertise. Learn about architectural changes implemented to enhance flexibility without compromising consistency. Gain insights into the platform's features, including preaggregation, SQL Glot, experimentation capabilities, and real-time metrics. Understand the evolution of Minerva from its humble beginnings to its current state, and get a glimpse of future plans for open-sourcing the platform. Delve into the metrics pipeline and the solutions devised to overcome growing pains in data management at Airbnb.

Introduction
Agenda
A humble start
Growing pains
What caused those issues
Why we created Minova
What does Minova do
Prior to Minova
Metrics in Minerva
Preaggregation
Challenges
How we addressed these issues
New architecture diagram
Querying with Minerva
SQL Glot
Experimentation
RealTime Metrics
Metrics Pipeline
Whats Next