Growing the Delta Ecosystem - Delta-RS for Rust and Python

Explore the delta-rs project in this 25-minute conference talk, which introduces how Delta Lake's capabilities are being extended beyond the Spark ecosystem. Discover the foundational Delta Lake library in Rust and its potential to enable native bindings in various programming languages. Learn about the current functionality of delta-rs in Rust and Python APIs, as well as the project's future roadmap. Gain insights into the kafka-delta-ingest project, a real-world application of delta-rs that facilitates high-throughput data transfer from Kafka to Delta Lake. Delve into Delta Lake basics, understand the motivations behind delta-rs, explore Rust's power, and see practical demonstrations in both Rust and Python. Examine the current capabilities, limitations, and community aspects of delta-rs, while understanding how it addresses specific challenges in data management and integration.

Intro
Delta Lake basics
Why delta-rs was needed
The power of Rust
Rust in action
Python in action
What you can do right now
What you can't quite do yet
kafka-delta-ingest
Problems to solve
delta-r's community