Serverless Kubernetes Boosts AI Business

Explore a 44-minute conference talk that delves into how serverless Kubernetes enhances AI business operations. Discover Huawei's implementation of serverless Kubernetes services (CCI) for running ML/DL workloads on their cloud platform. Learn about the benefits of this approach, including improved focus on core AI business logic and efficient handling of short-term jobs. Gain insights into key features such as using Kata containers for enhanced security in multi-tenant environments, support for multiple AI-specific devices like NVIDIA GPUs and InfiniBand, and the experience of running deep learning frameworks like TensorFlow on Kubernetes. Understand how these advancements are shaping the future of AI infrastructure management and deployment.

Serverless Kubernetes Boosts AI Business - Jian Huang, Huawei