Fast and Efficient Log Processing with Wasm and eBPF

Explore cutting-edge techniques for fast and efficient log processing using WebAssembly (Wasm) and eBPF in this informative conference talk. Discover how lightweight sandboxes like Wasm enable embedding log processing applications directly into Kubernetes pods, eliminating the need for dedicated servers with heavyweight software stacks. Learn about the integration of WASI and eBPF, allowing sandboxed Wasm apps to manage eBPF agents for collecting and processing kernel and network-level logging data. Witness a live demonstration of a complete Wasm application that collects, filters, transforms, and routes log entries from a MySQL binlog to a Kafka queue. Gain insights into incorporating an eBPF agent to gather and filter networking data through the MySQL server socket, complementing the binlog data. Enhance your understanding of modern log processing techniques and their potential to revolutionize cloud native services.

Fast and Efficient Log Processing with Wasm and eBPF - Michael Yuan, Second State