Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

CodeSignal

Working with DataFrames in PySpark

via CodeSignal

Go to class Write review

Overview

Unlock the dynamic world of PySpark DataFrames for advanced data manipulation. Master creation from various formats, and execute complex operations like filtering, joins, and handling missing data, scaling your ability to manage large datasets effectively.

Syllabus

  • Unit 1: Discovering PySpark DataFrames
    • Fill in the PySpark DataFrames
    • Showcase Desired Data Effortlessly
    • Explore DataFrame Schema with PySpark
    • Create DataFrames from List and RDD
  • Unit 2: Loading DataFrames from Files in PySpark
    • Loading DataFrames into PySpark
    • Changing Header Options in CSV
    • Debug PySpark DataFrame Loading
    • Enhance JSON Loading Skills
    • Master Loading DataFrames with PySpark
  • Unit 3: Performing Basic Operations on DataFrames
    • Complete Essential DataFrame Operations
    • Modify DataFrame and Observe Changes
    • Fix DataFrame Operations Mistake
    • Combine Operation into Single Chain
    • Harness PySpark DataFrame Magic
  • Unit 4: Handling Missing Values in PySpark DataFrames
    • Cleaning Up DataFrames Effortlessly
    • Customizing Missing Data Handling
    • Customize Row Dropping Logic
    • Master PySpark Missing Values Handling
  • Unit 5: Joining DataFrames and Exporting to Multiple Formats
    • Fill the Blanks for Join Mastery
    • Join Practice Change Challenge
    • Perform Inner Join and Export Data
    • Master DataFrame Joins and Exporting

Reviews

Start your review of Working with DataFrames in PySpark

Go to class

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free
Someone learning on their laptop while sitting on the floor.