Building WASM-Powered Distributed Stream Platform

Explore the development of a WASM-powered distributed stream platform in this conference talk. Discover how the Fluvio open-source project leverages WASM technology to create a more efficient and cost-effective data stack. Learn about the challenges and benefits of integrating SmartModule, a WASM-based module system, into distributed data processing. Gain insights into real-time economy, classical data processing, stream processing models, and the importance of reducing data movement. Examine the concept of edge smart stream processing and the role of WASM as a truly movable compute solution. Delve into the technical aspects of Fluvio's SmartModule, including filter binding, map binding, aggregate binding, and current store bindings. Understand the potential for improving store bindings and flattening the data stack into a unified system.

Intro
Agenda
Overview of Fluvio
Real-time economy
Classical Data Processing
Stream Processing Model
Composability
Moving data is not free
Costly Stream processing
Data movement is not secure
Solution: Reduce data movement
Edge Smart Stream processing
Compute for Smart Streaming
WASM: True Movable Compute
Flattening into Unified Stack
Fluvio: SmartModule
Filter Binding
Copying into WASM memory
Map Binding
Aggregate Binding
Current store bindings
Future Store bindings
Improve Store Binding