YoVDO

Scaling AI Health Assistants: Challenges and Solutions

Offered By: Anyscale via YouTube

Tags

Distributed Systems Courses Machine Learning Courses Scaling Courses Anyscale Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the challenges and solutions in scaling AI health assistants in this 28-minute conference talk by Anyscale. Delve into the development of a unique personal health experience using persistent models that incorporate expert systems, machine learning, and content distribution. Learn about the main challenges faced in scaling a stateful ecosystem robustly, including model and state management issues, and maintaining the health and reliability of interconnected components. Discover the solution built on top of Ray, covering overarching principles and design considerations. Gain key takeaways for building and scaling similar products in other contexts. Access the slide deck for visual reference and explore additional resources on Anyscale's AI Application Platform and Ray, the popular open source framework for scaling AI workloads.

Syllabus

Scaling AI Health Assistants: Challenges and Solutions


Taught by

Anyscale

Related Courses

Optimizing LLM Inference with AWS Trainium, Ray, vLLM, and Anyscale
Anyscale via YouTube
Scalable and Cost-Efficient AI Workloads with AWS and Anyscale
Anyscale via YouTube
End-to-End LLM Workflows with Anyscale
Anyscale via YouTube
Developing and Serving RAG-Based LLM Applications in Production
Anyscale via YouTube
Deploying Many Models Efficiently with Ray Serve
Anyscale via YouTube