YoVDO

Auto-scalable Microservices for Machine Learning - UnifyID Case Study

Offered By: Docker via YouTube

Tags

Machine Learning Courses Docker Courses Kubernetes Courses Microservices Courses GPU Computing Courses Auto-scaling Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore how UnifyID scales their Machine Learning back-end to service over 1 million users in this 16-minute conference talk. Discover techniques for running containers on EC2 GPU instances and addressing common challenges in deploying Machine Learning clusters in production. Learn about horizontal scaling using GPU information from NVML, creating a uniform API for ML microservices across multiple frameworks, and running unreliable academic ML code reliably in production. Gain insights into the design of an auto-scalable ML back-end, the open-source uniform API for Machine Learning microservices available on DockerHub, and the limitations of GPU horizontal scaling in Kubernetes and Mesos. Examine UnifyID's in-house built auto-scaler that leverages GPU information from NVML to optimize performance and resource utilization.

Syllabus

Auto-scalable microservices for Machine Learning @ UnifyID


Taught by

Docker

Related Courses

Introduction to Cloud Infrastructure Technologies
Linux Foundation via edX
Scalable Microservices with Kubernetes
Google via Udacity
Introduction to Kubernetes
Linux Foundation via edX
Architecting Distributed Cloud Applications
Microsoft via edX
IBM Cloud: Deploying Microservices with Kubernetes
IBM via Coursera