Fast Cars, Big Data - How Streaming Can Help Formula 1

Explore how modern data streaming can revolutionize Formula 1 data acquisition and analysis in this 49-minute Devoxx conference talk. Discover a working demonstration using a high-fidelity physics-based automotive simulator to produce realistic data from simulated cars on the Spa-Francorchamps track. Learn about moving data from cars to pits to engineers at HQ, resulting in near real-time visualization and performance comparison. Gain insights into using messaging systems like Kafka, processing data with Apache Spark, and analyzing with SQL using Apache Drill. Delve into topics such as data generation, real-time dashboards, data consumption, querying, and flattening. Explore big data projects, fast data processing, Kafka deployment, storage, and producer strategies. Understand MapReduce, Flink, and application frameworks through practical demonstrations and technology insights. Access the code from this talk on GitHub and benefit from the expertise of Tugdual Grall, a Technical Evangelist at MapR and open source advocate.

Intro
Agenda
Platform
Point of Data
Using Data
Capturing Data
The Data
Full Weekend
Data
Architecture
Talkz
Demo
Data generation
Realtime dashboard
Data consumption
Query
Flatten
ODBC
Big Data Project
Fast Data Hungry
Kafka
Classical Publish
Partition
Multiple partitions
Deployment
Storage
Producer
Strata API
Data Capture
New Data
New Service
MapReduce
Flink
Application Framework
Demonstration
Technology