Semi-Structured Communication Data with Delta Lake and Microservices

Explore a 36-minute conference talk that presents an innovative solution for efficiently storing and managing semi-structured communication data for eDiscovery using Delta Lake and microservices. Discover how this approach addresses the challenges posed by the increasing volume and complexity of data from short-form messaging platforms in legal processes. Learn about the development of microservices that provide abstracted layers of data access, enabling efficient querying, processing, and analysis of semi-structured communication data using technologies like delta-rs, Arrow Flight, and DataFusion. Gain insights into the implementation and integration of Delta Lake and these microservices, valuable for software engineers, data architects, and professionals interested in technology's impact on the legal industry. Presented by Alex Wilcoxson and Greg Ott, Staff Software Engineers at Relativity, this talk offers a strategic response to the evolving landscape of digital communication and its implications for legal processes.

Semi-Structured Communication Data with Delta Lake and Microservices