Building a Real-Time Analytics Database - A 'Choose Your Own Adventure' Journey

Explore the intricacies of building a real-time analytics database in this 47-minute conference talk from GOTO Chicago 2023. Join Tim Berglund, VP of DevRel at StarTree, as he guides you through a 'Choose Your Own Adventure' journey, detailing the crucial decisions and trade-offs involved in creating a low-latency, horizontally scalable analytics database. Discover the process of selecting a data model, making choices about serialization and storage, choosing indexing strategies, picking a query language, and determining how to scale. Learn how these decisions culminate in a system resembling Apache Pinot, a real-time analytics database optimized for ultra-low-latency, user-facing analytics at scale. Gain insights into how Pinot enables applications like LinkedIn and UberEats to expose system states to users, transforming them into decision-makers. Delve into Pinot's internals and understand the trade-offs made during its development, exploring how it facilitates a new class of applications that empower users with analytical capabilities.

Building a Real-Time Analytics Database • Tim Berglund • GOTO 2023