Dynamic Large Scale Spark on Kubernetes: Empowering the Community with Argo Workflows and Argo Events
Offered By: CNCF [Cloud Native Computing Foundation] via YouTube
Course Description
Overview
Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Discover how to build and manage large-scale Spark clusters on Kubernetes for powerful data processing in this informative conference talk. Learn best practices for constructing scalable Spark clusters on Kubernetes, with a focus on leveraging Argo Workflows and Argo Events. Explore the challenges of configuring storage, compute, networking, and optimizing job scheduling, whether starting from scratch or migrating Spark workloads from existing Hadoop clusters. Gain insights into harnessing the potential of Argo Workflows and Argo Events for event-driven job scheduling, enabling efficient resource utilization and seamless scalability. Understand how integrating these powerful open-source tools can provide better control and flexibility for executing Spark jobs on Kubernetes, empowering you to build highly scalable and efficient data processing environments.
Syllabus
Dynamic Large Scale Spark on Kubernetes: Empowering the Community wi... Ovidiu Valeanu & Vara Bonthu
Taught by
CNCF [Cloud Native Computing Foundation]
Related Courses
A Hands-On Look at Amazon Q Business ExpertAmazon Web Services via AWS Skill Builder À la découverte des télécommunications
Institut Mines-Télécom via France Université Numerique A Tour of Google Cloud Sustainability
Google via Google Cloud Skills Boost Intel® Telco Cloud Academy
Intel via Coursera Accéder à Internet depuis Lambda dans un VPC (Français) | Accessing the Internet from Lambda in a VPC (French)
Amazon Web Services via AWS Skill Builder