YoVDO

Bloomberg's Journey to a Multi-Cluster Workflow Orchestration Platform

Offered By: CNCF [Cloud Native Computing Foundation] via YouTube

Tags

Kubernetes Courses PostgreSQL Courses Data Pipelines Courses Model Training Courses Karmada Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore Bloomberg's journey in developing a multi-cluster workflow orchestration platform for automation, data pipelines, model training, and general utility compute. Learn about the challenges faced with rapid adoption, including increased latency and query timeouts. Discover the evolution from an initial implementation using bespoke in-cluster pull agents and a source-of-truth to a current approach leveraging a highly-available PostgreSQL database and Kine. Gain insights into the investigation of related projects and inspirations drawn from Karmada, OCM, and others. Understand the lightweight Kubernetes API server interface design that enables efficient multi-cluster federation for deploying heterogeneous resources.

Syllabus

Bloomberg's Journey to a Multi-Cluster Workflow Orchestration Platform - Yao Lin & Reinhard Tartler


Taught by

CNCF [Cloud Native Computing Foundation]

Related Courses

Karmada and Istio - Improving Workload and Traffic Resilience in Production Distributed Cloud
CNCF [Cloud Native Computing Foundation] via YouTube Break Through Cluster Boundaries to Autoscale Workloads Across Them on a Large Scale
CNCF [Cloud Native Computing Foundation] via YouTube Multi-Cloud, Multi-Cluster Orchestration with Karmada - June 19, 2024
CNCF [Cloud Native Computing Foundation] via YouTube Efficient Multi-Cluster GPU Workload Management with Karmada and Volcano
CNCF [Cloud Native Computing Foundation] via YouTube Enhancing Reliability Through Multi-Cluster Deployment: Leveraging the Power of Karmada
CNCF [Cloud Native Computing Foundation] via YouTube