YoVDO

Automating Cloud-native Spark Jobs with Argo Workflows

Offered By: Linux Foundation via YouTube

Tags

Apache Spark Courses Cloud Computing Courses Kubernetes Courses Distributed Systems Courses Data Processing Courses Scalability Courses Cloud Native Computing Courses Argo Workflows Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore how to orchestrate Apache Spark jobs using Argo Workflows in a cloud-native environment through this informative conference talk. Discover the challenges of managing dependencies in large computational workloads and learn how Kubernetes and Argo Workflows provide solutions for distributed environments. Gain insights into the architecture, resource management, and workflow definitions necessary for running Spark jobs on Kubernetes. Witness demonstrations of provisioning Spark and Argo Workflows, and understand the scaling and stability advantages they offer over traditional local or cloud environments. Evaluate the pros and cons of this approach to help determine if it's suitable for your data processing needs.

Syllabus

Automating Cloud-native Spark Jobs with Argo Workflows - Caelan Urquhart & Darko Janjić, Pipekit


Taught by

Linux Foundation

Tags

Related Courses

Coding the Matrix: Linear Algebra through Computer Science Applications
Brown University via Coursera
كيف تفكر الآلات - مقدمة في تقنيات الحوسبة
King Fahd University of Petroleum and Minerals via Rwaq (رواق)
Datascience et Analyse situationnelle : dans les coulisses du Big Data
IONIS via IONIS
Data Lakes for Big Data
EdCast
統計学Ⅰ:データ分析の基礎 (ga014)
University of Tokyo via gacco