Bridging the Gap - How Data and Software Engineering Teams Can Work Together to Ensure Smooth Data Integrations

Explore how data and software engineering teams can collaborate effectively to ensure smooth data integrations in this conference talk from GOTO Chicago 2023. Learn about the steps necessary for both teams to be ready for integrating with new production systems and delivering reliable analytics from day one. Discover key considerations in infrastructure, data access, data models, data flow, state changes, and data quality checks. Gain insights into the concept of "data contracts" and their role in maintaining consistent, high-quality data integrations. Benefit from practical advice on bridging the gap between data practitioners and software engineers, ensuring successful collaboration and timely delivery of actionable insights for new products or features.

Intro
TL;DR
About me
Agenda
The problem
1. Logistics
2. Infrastructure
3. Data model
4. Application & data flow
Data contracts
Wrapping up
Outro