Building a Dynamic Rules Engine with Kafka Streams

Explore the development of a dynamic rules engine using Kafka Streams in this 41-minute conference talk by Confluent. Dive into the architecture of Confluent SIGMA, an open-source project built on Kafka Streams for the open SIGMA DSL, designed to handle real-time rule additions and modifications in threat detection. Learn how to leverage external data feeds as rule input, manage dynamic criteria for joins and filters, and apply best practices for writing dynamic rule engines in Kafka Streams. Discover upcoming improvements to Kafka Streams that support versioned rules. Gain insights into applying this pattern to any domain-specific language that could benefit from real-time stream processing, enabling you to implement dynamic rules through Kafka Streams for various use cases beyond cyber threat detection.

Building a Dynamic Rules Engine with Kafka Streams