Deploying Apache Spark Jobs on Kubernetes with Helm and Spark Operator
Offered By: Databricks via YouTube
Course Description
Overview
Watch a 31-minute video demonstrating how to deploy Scala Spark jobs onto any Kubernetes environment using Helm and Spark Operator. Learn to make deployments more scalable with less need for custom configurations, resulting in boilerplate-free, highly flexible, and stress-free deployments. Explore alternatives, data-driven solutions, and the ecosystem surrounding Kubernetes. Follow along as the presenter creates a Kubernetes cluster, sets up a release entry, and performs a Helm deployment. Gain insights into streamlining your Spark job deployments on Kubernetes for improved efficiency and scalability.
Syllabus
Introduction
Alternatives
Not ready to deploy
Datadriven solutions
The ecosystem
Kubernetes
Kubernetes Cluster
Create Kubernetes Cluster
Release Entry
Spark Operator
Helm Deployment
Conclusion
Taught by
Databricks
Related Courses
Startup EngineeringStanford University via Coursera Developing Scalable Apps in Java
Google via Udacity Cloud Computing Concepts, Part 1
University of Illinois at Urbana-Champaign via Coursera Cloud Networking
University of Illinois at Urbana-Champaign via Coursera Cloud Computing Concepts: Part 2
University of Illinois at Urbana-Champaign via Coursera