YoVDO

Scheduling Jupyter Notebooks Using Airflow on Kubernetes

Offered By: CNCF [Cloud Native Computing Foundation] via YouTube

Tags

Kubernetes Courses Data Science Courses Jupyter Notebooks Courses Data Pipelines Courses Machine Learning Pipelines Courses Kubernetes Operators Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore how to schedule Jupyter notebooks using Airflow on Kubernetes in this informative conference talk by Akshay Chitneni and Rus Pandey from Apple. Discover the potential of extending Jupyter notebooks beyond interactive data analysis to build data and machine learning pipelines. Learn how Kubernetes constructs such as operators, autoscalers, and pod identities can be combined with Airflow to schedule notebooks and share execution results. Gain insights into creating a comprehensive notebooks platform that addresses user authentication, authorization, scalable compute, and isolated execution environments with dependencies. Understand how this approach can empower data scientists and engineers to accelerate the productionization of their work.

Syllabus

Scheduling Jupyter Notebooks Using Airflow on Kubernetes - Akshay Chitneni & Rus Pandey, Apple


Taught by

CNCF [Cloud Native Computing Foundation]

Related Courses

Data Analysis
Johns Hopkins University via Coursera Computing for Data Analysis
Johns Hopkins University via Coursera Scientific Computing
University of Washington via Coursera Introduction to Data Science
University of Washington via Coursera Web Intelligence and Big Data
Indian Institute of Technology Delhi via Coursera