Real Time Data Pipelines

Explore real-time data pipelines in this PHP UK Conference talk by Samantha Quiñones. Dive into the challenges and solutions of storing, analyzing, and distributing massive streams of analytics data from millions of consumer devices. Learn about the technologies used to collect, route, store, and extract meaning from data at 20 MB/s. Discover the evolution of a data pipeline system through different versions, including the implementation of Elasticsearch clustering and embeddable visualizations. Gain insights into cross-platform eventing and understand the intricacies of pipeline mapping in the context of one of the world's top digital media platforms.

REAL-TIME DATA PIPELINES
CASE STUDY
BEACON PAYLOAD
THE PROOF OF CONCEPT
VERSION 1
VERSION 2 (JAVA BOOGALOO)
ELASTICSEARCH CLUSTERING
EMBEDDABLE VISUALIZATIONS
CROSS-PLATFORM EVENTING
PIPELINE MAP