Airbyte: Data Acquisition for Modern Data Platforms

Explore the fundamentals of modern data platforms and discover Airbyte's role in efficient data acquisition during this comprehensive 1-hour 14-minute session. Delve into the plugin-type architecture of Airbyte, which facilitates rapid data collection from diverse sources. Gain insights into Airbyte's extensibility by examining its Connector development kit. Learn about essential components such as data lakes, data infrastructure, ETL tools, data governance, and data privacy. Understand the process of creating a data platform, including the use of DBT and various connectors. Dive into Airbyte's internals, workers, and demo sources. Master the creation of custom connector scripts, spec checks, discovery processes, and the implementation of multiple connectors.

Intro
Agenda
Data Lakes
Data Infrastructure
ETL Tools
Data Governance
Data Privacy
How do you create this platform
DBT
Connectors
Internals
Workers
Demo
Source
Custom Connector Script
Spec
Check
Discover
Multiple connectors
Connector spec