Choosing a System for Large-Scale Data Analysis - Hot vs Cold Approaches

Explore the landscape of large-scale data analysis systems in this 40-minute conference talk. Delve into the diverse architectures of popular systems and understand why finding a perfect solution remains elusive. Learn to evaluate different systems' capabilities on a spectrum and consider what it might take to achieve comprehensive functionality. Gain insights into the distinctions between hot and cold data, online analytics, and exploration and monitoring. Journey through the evolution of data management, from relational databases to data warehouses, OLAP databases, and the big data era. Examine Apache Druid's purpose, real-world applications, and microservice architecture. Compare Druid with query engines and explore the concept of spot elasticity. Enhance your understanding of large-scale data analysis systems to make informed decisions for your organization's needs.

Introduction
Who am I
Agenda
Hot vs Cold
Online Analytics
Exploration and Monitoring
Where are these useful
Why tolerate cold data
Strolling down memory lane
Relational database
Data warehouses
OLAP databases
Big data era
Serving databases
Apache Druids Purpose
Druid in the Wild
Why Care
How Does It Work
Microservice Architecture
Example Segment
Can We Have It All
Druid vs Query Engines
Spot Elasticity
Questions