Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Master Databricks and Apache Spark Step by Step

Bryan Cafferky via YouTube

Overview

Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Learn to master Databricks and Apache Spark through this comprehensive 13 hour 58 minute course that takes you step-by-step from basic concepts to advanced implementations. Begin by creating a Databricks workspace and understanding the data science process, then dive deep into Spark SQL including data definition language, table creation, views, joins, set operators, functions, and window functions. Progress to PySpark programming where you'll work with RDDs, DataFrames, user-defined functions (UDFs), pandas UDFs, and database connectivity for parallel queries. Explore the evolution from Koalas to Pandas on Spark for enhanced data manipulation capabilities. Expand your skillset by learning R integration with Spark through Arrow, SparkR, and sparklyr, then master Scala programming with RDDs, DataFrames, and Datasets. Gain practical experience through hands-on demonstrations, notebook exercises, and real-world examples that prepare you to leverage the full power of distributed computing for big data analytics and machine learning workflows.

Syllabus

Master Databricks and Apache Spark Step by Step: Series Overview
Master Databricks and Apache Spark Step by Step: Lesson 1 - Introduction
Master Databricks and Apache Spark Step by Step: Lesson 2 - Create a Databricks Workspace
Master Databricks and Apache Spark Step by Step: Lesson 3 - Databricks Demo
Master Databricks & Apache Spark Step by Step: Lesson 4 - Create a Spark Cluster
Master Databricks & Apache Spark Step by Step: Lesson 5 - Using The Data Science Process
Master Databricks and Apache Spark Step by Step: Lesson 6 - Understanding Spark SQL (fixed sound)
Master Databricks and Apache Spark Step by Step: Lesson 7 - Spark SQL Data Definition Language.
Master Databricks and Apache Spark Step by Step: Lesson 9 - Creating the SQL Tables on Databricks
Master Databricks and Apache Spark Step by Step: Lesson 8 - Spark SQL DDL on Spark
Master Databricks and Apache Spark Step by Step: Lesson 10 - Creating the SQL Tables on Spark
Master Databricks and Apache Spark Step by Step: Lesson 11 - Saving Query Results to Tables
Master Databricks and Apache Spark Step by Step: Lesson 12 - Using SQL Views
Master Databricks and Apache Spark Step by Step: Lesson 13 - Using SQL Joins
Master Databricks and Apache Spark Step by Step: Lesson 14 - Using SQL Set Operators
Master Databricks and Apache Spark Step by Step: Lesson 15 - Using SQL Functions
Master Databricks and Apache Spark Step by Step: Lesson 16 - Using SQL Window Functions
Master Databricks and Apache Spark Step by Step: Lesson 17 - Saving Query Results to Tables on Spark
Master Databricks and Apache Spark Step by Step: Lesson 18 - Using SQL Views on Spark
Master Databricks and Apache Spark Step by Step: Lesson 19 - SQL Zeppelin Notebook Catch Up
Master Databricks and Apache Spark Step by Step: Lesson 20 - PySpark Introduction
Master Databricks and Apache Spark Step by Step: Lesson 21 - PySpark Using RDDs
Master Databricks and Apache Spark Step by Step: Lesson 22 - PySpark Using SQL
Master Databricks and Apache Spark Step by Step: Lesson 23 - Using PySpark Dataframe Methods
Master Databricks and Apache Spark Step by Step: Lesson 24 - Creating PySpark Dataframe Scalar UDFs
Master Databricks and Apache Spark Step by Step: Lesson 25 - PySpark: Using SQL Aggregate Functions
Master Databricks and Apache Spark Step by Step: Lesson 26 - PySpark: Intro to the New pandas UDFs
Master Databricks and Apache Spark Step by Step: Lesson 27 - PySpark: Coding pandas UDFs
Master Databricks and Apache Spark Step by Step: Lesson 28 - PySpark: Coding pandas Scalar UDFs
Master Databricks and Apache Spark Step by Step: Lesson 29 - PySpark: Coding pandas Function API
Master Databricks and Apache Spark Step by Step: Lesson 30 - PySpark: Reading from a SQL Database
Master Databricks and Apache Spark Step by Step: Lesson 31 - PySpark: Parallel Database Queries
Master Databricks and Apache Spark Step by Step: Lesson 32 - Koalas: Pandas on Spark!
Master Databricks and Apache Spark Step by Step: Lesson 33 - Goodbye Koalas: Hello Pandas on Spark!
Master Databricks and Apache Spark Step by Step: Lesson 34 - Use R with Arrow = Awesome Performance
Master Databricks and Apache Spark Step by Step: Lesson 35 - How to use SparkR (R on Spark)
Master Databricks and Apache Spark Step by Step: Lesson 36 - How to use R on Spark with sparklyr
Master Databricks and Apache Spark Step by Step: Lesson 37 - Using Scala
Master Databricks and Apache Spark Step by Step: Lesson 38 - Using RDDs in Scala
Master Databricks and Apache Spark Step by Step: Using Scala Dataframes & Datasets
Master Databricks and Apache Spark Step by Step: Series Update - What's Changed?
Master Databricks and Apache Spark Step by Step: Lesson 40 - Features, Trends, and Direction

Taught by

Bryan Cafferky

Reviews

Start your review of Master Databricks and Apache Spark Step by Step

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.