Overview

Updated in May 2025. This course now features Coursera Coach — your interactive learning companion that helps you test your knowledge, challenge assumptions, and deepen your understanding as you progress. Build a strong foundation in Azure Databricks, the unified analytics and data engineering platform used across modern cloud environments. Designed for beginners, this hands-on course guides you through setting up your Databricks workspace, creating Spark clusters, and integrating Azure services so you can process and manage data efficiently at scale. You’ll begin by reviewing the course prerequisites and exploring the core resources you’ll use throughout your learning journey. With step-by-step guidance, you’ll set up your Azure cloud account, configure your Databricks workspace, and learn to navigate the Azure portal — giving you the essential groundwork to use the platform confidently. As you progress, you’ll start working directly inside the Databricks workspace, creating and configuring Spark clusters and writing code in Databricks notebooks. You’ll explore notebook features such as magic commands, the Databricks Utilities package, and interactive data processing workflows that make Databricks a powerful environment for big data engineering. By the end of this course, you will have: - Set up and configured an Azure Databricks workspace from scratch. - Created and managed Spark clusters for scalable data processing. - Used Databricks notebooks, magic commands, and Databricks Utilities to streamline workflows. - Integrated Databricks with Azure services for end-to-end data engineering tasks. - Gained practical experience needed to begin working confidently with Azure Databricks. This course is ideal for aspiring data engineers, cloud practitioners, and beginners who want hands-on skills with Azure Databricks. No prior experience is required, though familiarity with cloud or data concepts is helpful.

Syllabus

Before you start

In this module, we will outline the prerequisites for this course, explain the course structure, and provide instructions on accessing materials and resources. We will also share important notes to ensure you're well-prepared for the learning journey ahead.

Introduction

In this module, we will introduce you to data engineering, explain the significance of Apache Spark in this domain, and provide an overview of the Databricks platform. You will gain foundational knowledge essential for using these tools effectively.

Getting Started

In this module, we will guide you through the process of setting up your Azure account and the Databricks workspace. You will also learn how to navigate the Azure portal and understand the architecture of the Azure Databricks platform.

Working in Databricks Workspace

In this module, we will cover the essential tools and features within the Databricks workspace. You’ll learn how to work with Spark clusters, use Databricks notebooks, and leverage magic commands and utilities for improved workflow efficiency.

Working with Databricks File System - DBFS

In this module, we will introduce the Databricks File System (DBFS) and teach you how to manage files within it. You will also learn how to mount Azure Data Lake Storage (ADLS) to DBFS for streamlined data integration.