Multi-Model Composition with Ray Serve Deployment Graphs
Offered By: Anyscale via YouTube
Course Description
Overview
Explore multi-model composition using Ray Serve deployment graphs in this 30-minute talk from Anyscale. Discover how to leverage Ray's programmable and general-purpose distributed computing capabilities to author, orchestrate, scale, and deploy complex serving graphs as a DAG under a unified set of APIs. Learn to program multiple models dynamically on your laptop as if writing a local Python script, deploy to production at scale, and perform individual upgrades. Gain insights into streamlining microservice-like functionality for efficient model deployment and management.
Syllabus
Multi-model composition with Ray Serve deployment graphs
Taught by
Anyscale
Related Courses
Financial Sustainability: The Numbers side of Social Enterprise+Acumen via NovoEd Cloud Computing Concepts: Part 2
University of Illinois at Urbana-Champaign via Coursera Developing Repeatable ModelsĀ® to Scale Your Impact
+Acumen via Independent Managing Microsoft Windows Server Active Directory Domain Services
Microsoft via edX Introduction aux conteneurs
Microsoft Virtual Academy via OpenClassrooms