Managing Large-Scale Ray Deployments - Cloud, On-Prem, and Kubernetes
Offered By: Anyscale via YouTube
Course Description
Overview
Explore the complexities of managing Ray at scale across diverse environments in this Ray Summit 2024 breakout session. Delve into Anyscale's approach to handling millions of cores across Cloud, On-premises, and Kubernetes platforms. Learn about the design principles behind Anyscale's platform, which manages numerous Ray clusters running various workloads in complex settings. Discover insights into three key deployment scenarios: cloud infrastructure management, on-premises deployment using Anyscale Machine Pools, and Kubernetes integration via the Anyscale Operator for Kubernetes. Gain a technical perspective on large-scale distributed computing management, including challenges and solutions for each deployment type. Acquire valuable information relevant to organizations looking to scale their Ray deployments across different infrastructures.
Syllabus
Managing Large-Scale Ray Deployments: Cloud, On-Prem, and Kubernetes | Ray Summit 2024
Taught by
Anyscale
Related Courses
Optimizing LLM Inference with AWS Trainium, Ray, vLLM, and AnyscaleAnyscale via YouTube Scalable and Cost-Efficient AI Workloads with AWS and Anyscale
Anyscale via YouTube End-to-End LLM Workflows with Anyscale
Anyscale via YouTube Developing and Serving RAG-Based LLM Applications in Production
Anyscale via YouTube Deploying Many Models Efficiently with Ray Serve
Anyscale via YouTube