Stream All Things - Patterns of Modern Data Integration

Explore patterns of modern data integration in this 49-minute conference talk from GOTO Chicago 2017. Dive into the challenges of data integration and learn about innovative solutions using event streaming and Apache Kafka. Discover how software engineers are changing the landscape of data management through event-driven microservices and streaming architectures. Gain insights on maintaining compatibility, implementing Kafka consumers, and leveraging "hipster" stream processing techniques. Examine data store integration, connectors, and the architecture behind efficient data capture and stream-to-table joins. Investigate advanced topics such as search relevance, inference, and hash tables in streaming contexts. Understand the complexities of modern data integration and how to meet evolving stream expectations in this comprehensive presentation by Gwen Shapira, Product Manager at Confluent.

Intro
What happened to data management
Who does things change
Software Engineers
Streaming Everything
Events
Page Movement
Page Reasons
Event Driven Micro Services
Event Driven microservices
Kafka
Logs
Partitions
Kafka Events
Compatibility
Maintaining compatibility
Compatibility in production
Simple changes
Kafka Consumer
Hipster Stream Processing
Data Store Integration
Connectors
Promotion
In property
Architecture
Database
Streams
Data Capture
Stream to Table Join
Stream to Questions
Search Relevance
Inference
Hash Table
Time
Hash Tables
Complexity
Keep Compatibility
cough the summit
Stream Expectations