YoVDO

Scaling to Millions of ML Models to Solve the Problems of SRE and Security

Offered By: CNCF [Cloud Native Computing Foundation] via YouTube

Tags

Conference Talks Courses Machine Learning Courses Kubernetes Courses Apache Spark Courses Time Series Analysis Courses Prometheus Courses Anomaly Detection Courses Apache Arrow Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore a conference talk on scaling machine learning models to improve SRE and security efficacy. Learn how to leverage millions of ML models operating on petabytes of operational and user data to enhance zero trust security frameworks and infrastructure diagnosis. Discover the challenges and solutions in implementing machine learning and anomaly detection on Kubernetes nodes and Envoy-based service mesh. Gain insights into collecting data from hundreds of thousands of nodes, handling high cardinality of models, and distributing inference models to K8s nodes. Understand the integration of open-source technologies like Kubernetes, Prometheus, Cortex, Apache Spark, and Apache Arrow in a production deployment. Delve into the complex architecture, infrastructure scaling, and Databricks integration. Examine code snippets and practical applications of the Group pandas API and Apache Arrow.

Syllabus

Introduction
Meet the speakers
Agenda
What is Volterra
Machine Learning Applications
Metrics and Locks
Complex Architecture
Infrastructure
Scaling
Spark and Kubernetes
Databricks Integration
Apache Arrow
Group pandas API
Code snippet
Conclusion


Taught by

CNCF [Cloud Native Computing Foundation]

Related Courses

CS115x: Advanced Apache Spark for Data Science and Data Engineering
University of California, Berkeley via edX
Big Data Analytics
University of Adelaide via edX
Big Data Essentials: HDFS, MapReduce and Spark RDD
Yandex via Coursera
Big Data Analysis: Hive, Spark SQL, DataFrames and GraphFrames
Yandex via Coursera
Introduction to Apache Spark and AWS
University of London International Programmes via Coursera