YoVDO

Scheduling Jupyter Notebooks Using Airflow on Kubernetes

Offered By: CNCF [Cloud Native Computing Foundation] via YouTube

Tags

Kubernetes Courses Data Science Courses Jupyter Notebooks Courses Data Pipelines Courses Machine Learning Pipelines Courses Kubernetes Operators Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore how to schedule Jupyter notebooks using Airflow on Kubernetes in this informative conference talk by Akshay Chitneni and Rus Pandey from Apple. Discover the potential of extending Jupyter notebooks beyond interactive data analysis to build data and machine learning pipelines. Learn how Kubernetes constructs such as operators, autoscalers, and pod identities can be combined with Airflow to schedule notebooks and share execution results. Gain insights into creating a comprehensive notebooks platform that addresses user authentication, authorization, scalable compute, and isolated execution environments with dependencies. Understand how this approach can empower data scientists and engineers to accelerate the productionization of their work.

Syllabus

Scheduling Jupyter Notebooks Using Airflow on Kubernetes - Akshay Chitneni & Rus Pandey, Apple


Taught by

CNCF [Cloud Native Computing Foundation]

Related Courses

Introduction to Data Science in Python
University of Michigan via Coursera Julia Scientific Programming
University of Cape Town via Coursera Python for Data Science
University of California, San Diego via edX Probability and Statistics in Data Science using Python
University of California, San Diego via edX Introduction to Python: Fundamentals
Microsoft via edX