Last Mile Data Processing for ML Training Using Ray at Pinterest

Explore how Pinterest integrated Ray to optimize ML innovations in this 28-minute conference talk. Learn about scaling the end-to-end ML lifecycle from data processing to model training within a single Job, reducing the need for workflow frameworks and boosting ML developer productivity. Discover the integration of Ray with Pinterest's in-house Kubernetes infrastructure and its support for business-critical use cases. Gain insights into challenges faced, lessons learned, and the benefits Ray brings to Pinterest's operations. Access the slide deck for additional information and explore Anyscale's AI Application Platform for developing, running, and scaling AI workloads. Understand Ray's role as a popular open-source framework for scaling and productionizing AI workloads, including Generative AI, LLMs, and computer vision.

Last Mile Data Processing for ML Training using Ray