Streamline Real-Time Ingestion and Serving with DLT and Online Tables

Discover how Västtrafik, West Sweden's public transport authority, implements a near real-time ingestion framework for its Travel Planner App using Delta Live Tables and Brickstore in this 31-minute conference talk. Learn about the challenges of low latency pipelines, including small files, inefficient autoscaling, monitoring, and complex serving setups. Explore solutions that balance cost and latency while reducing complexity. Gain insights into DLT's out-of-the-box capabilities and Brickstore's simple, fast, and scalable serving approach. See how these technologies improve service reliability, travel experience, and customer satisfaction for Västtrafik's bus, ferry, train, and tram services. Presented by Magnus Johannesson, Solutions Architect and Data Engineer at Västtrafik, and Sanjeev Kumar, SSA at Databricks.

Streamline Real Time Ingestion and Serving with DLT and Online Tables