Automating Cloud-native Spark Jobs with Argo Workflows
Offered By: Linux Foundation via YouTube
Course Description
Overview
Explore how to orchestrate Apache Spark jobs using Argo Workflows in a cloud-native environment through this informative conference talk. Discover the challenges of managing dependencies in large computational workloads and learn how Kubernetes and Argo Workflows provide solutions for distributed environments. Gain insights into the architecture, resource management, and workflow definitions necessary for running Spark jobs on Kubernetes. Witness demonstrations of provisioning Spark and Argo Workflows, and understand the scaling and stability advantages they offer over traditional local or cloud environments. Evaluate the pros and cons of this approach to help determine if it's suitable for your data processing needs.
Syllabus
Automating Cloud-native Spark Jobs with Argo Workflows - Caelan Urquhart & Darko Janjić, Pipekit
Taught by
Linux Foundation
Tags
Related Courses
Kubernetes: Cloud Native EcosystemLinkedIn Learning Kubernetes: Cloud Native Ecosystem
LinkedIn Learning Cloud Native Certified Kubernetes Administrator (CKA) (Legacy)
A Cloud Guru Implement Resiliency in a Cloud-Native ASP.NET Core Microservice
Microsoft via YouTube Open Networking & Edge Executive Forum 2021 - Day 1 Part 2 Sessions
Linux Foundation via YouTube