A Cloud-Native Parallel Data Processing Application in Julia

Explore a cloud-native parallel data processing application built in Julia through this 30-minute conference talk. Dive into the intersection of research and production as the speakers explain the application's design, highlighting Julia's strengths in writing expressive and performant code. Learn about the implementation of AWS services, containerization techniques, and parallel processing in Julia. Gain insights into debugging and profiling methods using tools like Tracy.jl, Intel VTune, and Profiling.jl. Discover the challenges faced when developing such an application in Julia and understand the potential areas for improvement. Examine ongoing efforts to simplify the identification of performance-impeding lock contention. Acquire valuable knowledge on transitioning Julia code from research to production-level systems in cloud environments.

A cloud-native parallel data processing application in Julia | Butterworth, Benasutti