Streaming with Structure

Explore the intricacies of using schemas and schema registries in Apache Kafka-based publish-subscribe messaging systems in this 38-minute conference talk from GOTOpia February 2021. Dive into common schema formats used in the Kafka community, learn about different schema registries, and discover how to implement schemas in various Kafka applications. Follow along as Software Engineer Katherine Stanley uses a barista example to illustrate concepts, covering topics such as JSON usage, adding structure with schemas, choosing the right schema format, and working with serdes and converters. Gain insights into Apicurio and Confluent schema registries, and understand how effective streaming with structure can minimize coupling between applications while maintaining data consistency and compatibility.

Intro
Barista example
Using JSON
Adding structure with schemas
Schema registry
What format to use?
Which schema to choose?
Serdes and converters
Apicurio registry
Confluent schema registry
Summary
Outro