Serverless Datastream Processing

Explore serverless datastream processing in this 31-minute Devoxx conference talk by Martin Görner. Dive into the shift from big data to fast data, and learn how to build an end-to-end system using serverless components on Google Cloud Platform. Discover how to handle messages, process complex datastreams, manage persistence, query and clean data, and implement machine learning for both training and serving predictions. Follow along as Görner demonstrates these concepts using a real-world example of a business running a fleet of connected taxis in NYC. Gain insights into topics such as PubSub, Dataflow, downsampling, visualization, BigQuery, ML Engine, and data preparation. This Java-focused talk is ideal for developers interested in cutting-edge datastream processing techniques and serverless architectures.

Introduction
PubSub
Dataflow
Downsampling
Visualization
Taxes
Configuration
BigQuery
Save data to disk
BigQuery demo
Machine learning
Architecture
Data prep
Data cleaning
ML Engine
Deployment
Demo
Training model
Data flow