Exploring UDTFs and Polymorphism in PySpark
Offered By: Databricks via YouTube
Course Description
Overview
Dive into a 20-minute presentation exploring User-Defined Table Functions (UDTFs) in PySpark. Learn the fundamentals of UDTFs, including their structure and capabilities, before delving into the concept of polymorphism. Discover how to create polymorphic UDTFs that adapt to various input schemas and data types. Examine practical examples showcasing the versatility of both standard and polymorphic UDTFs in PySpark. Gain insights from Databricks Software Engineers Haejoon Lee and Takuya Ueshin as they demonstrate how to enhance data processing flexibility using these powerful tools.
Syllabus
Exploring UDTFs (User-Defined Table Functions) in PySpark
Taught by
Databricks
Related Courses
Introduction to DatabasesMeta via Coursera Web Development
Udacity Introduction to Data Science
University of Washington via Coursera Datenmanagement mit SQL
openHPI Sabermetrics 101: Introduction to Baseball Analytics
Boston University via edX