Learn AI, Data Science & Business — Earn Certificates That Get You Hired
Master Production-Ready Machine Learning, Step by Step
Overview
Google, IBM & Meta Certificates – 40% Off
One plan covers every Professional Certificate on Coursera.
Unlock All Certificates
Dive into a 20-minute presentation exploring User-Defined Table Functions (UDTFs) in PySpark. Learn the fundamentals of UDTFs, including their structure and capabilities, before delving into the concept of polymorphism. Discover how to create polymorphic UDTFs that adapt to various input schemas and data types. Examine practical examples showcasing the versatility of both standard and polymorphic UDTFs in PySpark. Gain insights from Databricks Software Engineers Haejoon Lee and Takuya Ueshin as they demonstrate how to enhance data processing flexibility using these powerful tools.
Syllabus
Exploring UDTFs (User-Defined Table Functions) in PySpark
Taught by
Databricks