Our DataMesh Journey - Data Architectures for Microservices

Explore the journey of implementing DataMesh architecture for microservices in this Spring I/O 2022 conference talk. Dive into the challenges and solutions of data sharing between microservices and offline data consumers in the age of autonomous teams and continuous delivery. Learn about eDreams' two-year experience implementing DataMesh, focusing on motivation, technical solutions, and organizational transformation. Discover the architecture of their current implementation, including technologies used and trade-offs made to balance team autonomy, data ownership, quality, privacy regulations, and infrastructure costs. Gain insights into the organizational challenges faced when replacing existing data systems and explore open issues and future work in this field.

Introduction
Agenda
Context
The monolith
Splitting the monolith
Data sharing
Simple query
Good and bad things
Booking indexer
Public indexer
Booking engine
Query by ID
Learnings
Domain Events
Implementation details
Landing pages and bookings
Analytical BI
Data lakes
DataMesh
New Paradigm
Architecture Design Implementation
Budget
Rollout
Architecture
Data Loss
Data Loss Metrics
Feedback Loops
Questions
How to document domain events
Publishing events
How do you decide which data goes
Can I store this data
How do I know the state of the group
Single point of failure
Snapshots
Data persistence
Main events