YoVDO

Running AI Inference on Google Kubernetes Engine - Anthropic's Approach with Claude

Offered By: Google Cloud Tech via YouTube

Tags

Artificial Intelligence Courses Machine Learning Courses Cloud Computing Courses Kubernetes Courses Inference Courses Claude Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Discover how Anthropic leverages Google Kubernetes Engine (GKE) to run inference for Claude, achieving cost efficiency and high performance using Google tensor processing units (TPUs) and NVIDIA graphics processing units. Learn about Anthropic's improved price-performance on TPU v5e, GKE's advanced management capabilities for simplified Day-2 maintenance, and the exceptional support provided by Google Cloud. Explore topics such as customer-triggered maintenance, Cube for Claude, Google TPU, Kubernetes orchestration, cost-efficient inference, GPU recommendations, and GKE features in this 29-minute conference talk from Google Cloud Next 2024.

Syllabus

Introduction
About Anthropic
Customer triggered maintenance
Cube for Claude
Google TPU
Kubernetes Orchestration
Cost Efficient Inference
GPU Recommendations
GKE


Taught by

Google Cloud Tech

Related Courses

Introduction to Artificial Intelligence
Stanford University via Udacity Natural Language Processing
Columbia University via Coursera Probabilistic Graphical Models 1: Representation
Stanford University via Coursera Computer Vision: The Fundamentals
University of California, Berkeley via Coursera Learning from Data (Introductory Machine Learning course)
California Institute of Technology via Independent