Exploring UDTFs and Polymorphism in PySpark

Offered By: Databricks via YouTube

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!

Dive into a 20-minute presentation exploring User-Defined Table Functions (UDTFs) in PySpark. Learn the fundamentals of UDTFs, including their structure and capabilities, before delving into the concept of polymorphism. Discover how to create polymorphic UDTFs that adapt to various input schemas and data types. Examine practical examples showcasing the versatility of both standard and polymorphic UDTFs in PySpark. Gain insights from Databricks Software Engineers Haejoon Lee and Takuya Ueshin as they demonstrate how to enhance data processing flexibility using these powerful tools.

Syllabus

Exploring UDTFs (User-Defined Table Functions) in PySpark

Taught by

Databricks

Related Courses

Coding the Matrix: Linear Algebra through Computer Science Applications
Brown University via Coursera كيف تفكر الآلات - مقدمة في تقنيات الحوسبة
King Fahd University of Petroleum and Minerals via Rwaq (رواق) Datascience et Analyse situationnelle : dans les coulisses du Big Data
IONIS via IONIS Data Lakes for Big Data
EdCast 統計学Ⅰ：データ分析の基礎 (ga014)
University of Tokyo via gacco