Pinterest's ML Evolution: Distributed Training with Ray
Offered By: Anyscale via YouTube
Course Description
Overview
Explore Pinterest's journey in optimizing machine learning recommender systems through distributed training with Ray in this 27-minute conference talk from Ray Summit 2024. Dive into the challenges and innovative solutions implemented by Pinterest's ML Platform team to scale data-intensive model training across thousands of jobs. Learn how they leveraged the Ray ecosystem to decompose and orchestrate massive workloads, addressing issues like memory pinning and multi-threaded collate. Discover the significant improvements in training throughput achieved through these optimizations and gain insights into Pinterest's ongoing efforts to enhance their ML infrastructure through internal abstractions and open-source contributions.
Syllabus
Pinterest's ML Evolution: Distributed Training with Ray | Ray Summit 2024
Taught by
Anyscale
Related Courses
Introduction to Recommender SystemsUniversity of Minnesota via Coursera Text Retrieval and Search Engines
University of Illinois at Urbana-Champaign via Coursera Machine Learning: Recommender Systems & Dimensionality Reduction
University of Washington via Coursera Java Programming: Build a Recommendation System
Duke University via Coursera Introduction to Recommender Systems: Non-Personalized and Content-Based
University of Minnesota via Coursera