Building a Real-Time AI Data Platform with Apache Kafka

Explore the journey of building a real-time AI data platform using Apache Kafka in this 37-minute video from Confluent. Learn how Forecasty.ai, an artificial intelligence platform for forecasting commodity prices, transitioned from batch processing to a real-time event streaming system. Discover the challenges faced, innovative solutions implemented, and the benefits of using Kafka components without stateful stream processing. Gain insights into AI techniques for forecast modeling, the migration process from batch to real-time processing, and the development of kash.py, a Python-based Kafka shell. Understand the future plans for leveraging Kafka and how to create a scalable, efficient, and environmentally friendly data platform for real-time insights in the ever-changing world of commodity pricing.

- Intro
- What is Forecasty.ai?
- Using AI techniques for forecast modeling
- Migrating from batch to real-time stream processing
- Getting started with Apache Kafka
- Building kash.py—a Python-based Kafka shell
- Future plans for using Kafka
- It's a wrap!