YoVDO

Optimizing Kubernetes Cluster Scaling for Advanced Generative Models

Offered By: Linux Foundation via YouTube

Tags

Kubernetes Courses Argo Courses Generative Models Courses MLFlow Courses Kubeflow Courses Cluster Scaling Courses KServe Courses Flyte Courses vLLM Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore advanced techniques for optimizing Kubernetes cluster scaling to support complex generative models in this comprehensive workshop. Dive into the latest enhancements in Kubernetes that enable effective GPU resource utilization and dynamic sharing within nodes. Learn how to evaluate and integrate tools like Flyte, MLflow, Kubeflow, Kserve, vLLM, and Argo into hybrid Kubernetes clusters for streamlined development, deployment, and management of generative models. Gain valuable insights into the unique features and capabilities of each tool, understanding their contributions to scalability, efficiency, and maintainability in hybrid Kubernetes environments. Discover strategies to meet the growing demand for scalable infrastructure capable of supporting advanced automation and machine learning workloads.

Syllabus

Workshop: Optimizing Kubernetes Cluster Scaling for Adv...- Shivay Lamba & Shivanshu Raj Shrivastava


Taught by

Linux Foundation

Tags

Related Courses

Finetuning, Serving, and Evaluating Large Language Models in the Wild
Open Data Science via YouTube
Cloud Native Sustainable LLM Inference in Action
CNCF [Cloud Native Computing Foundation] via YouTube
LLaMa for Developers
LinkedIn Learning
Scaling Video Ad Classification Across Millions of Classes with GenAI
Databricks via YouTube
Accelerating LLM Inference with vLLM
Databricks via YouTube