Extending a High-performance Data Streaming System with WebAssembly

Explore the integration of WebAssembly (Wasm) into high-performance data streaming systems in this 25-minute conference talk by Tyler Rockwood from Redpanda. Discover how Wasm-powered functions can solve 60-70% of stream processing use cases directly within streaming storage systems, eliminating data ping-pong and reducing latency and resource consumption. Delve into the challenges faced when integrating a Wasm runtime into Redpanda, a distributed high-performance streaming storage engine built with the Seastar framework. Learn about the unique obstacles encountered in supporting arbitrary user functions within an execution environment that has strict bounds on memory consumption and latency. Gain insights into the developer experience designed to balance ease of use with performance in this demanding environment.

Extending a High-performance Data Streaming System with WebAssembly - Tyler Rockwood, Redpanda