Dive into Avro: Everything a Data Engineer Needs to Know

Explore Apache Avro, the de-facto standard for serializing structured data, in this comprehensive 40-minute conference talk from ApacheCon 2022. Gain valuable insights into the inner workings of Avro, its importance in big data engines, streaming platforms, and data lakes, and learn how it optimizes storage and transmission of data. Delve into essential topics, potential pitfalls, and best practices for implementing Avro in your systems, including types and schemas, logical types, binary and JSON serialization, and code generation. Discover the robust ecosystem of tools supporting Avro and gain a deeper understanding of schema evolution, a crucial concept in event-driven architectures. Whether you're a seasoned data engineer or new to the field, this presentation by Ryan Skraba and Ismaël Mejía provides the knowledge needed to effectively leverage Avro in your data engineering projects.

Dive into Avro Everything a data engineer needs to know Ryan Skraba, Ismael Mejia