Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Microsoft

Data Storage & Processing

Microsoft via Coursera

Overview

Google, IBM & Meta Certificates – 40% Off
One plan covers every Professional Certificate on Coursera.
Unlock All Certificates
Master the data storage patterns and processing techniques that power enterprise analytics in Microsoft Fabric. In this hands-on course, you’ll design scalable lakehouse solutions and build production-grade storage architectures that support performance, governance, and advanced analytics workloads. You’ll implement a Medallion architecture in OneLake using bronze, silver, and gold layers, and register lineage in Microsoft Purview. You’ll ingest data into a Fabric Lakehouse using pipelines, Copy Jobs, and notebooks while selecting appropriate Delta table types. You’ll query data through the SQL Endpoint for analysis and use notebooks for programmatic access, then enforce consistency with time-travel queries and MERGE-based ACID transactions using Delta Lake. You’ll also optimize tables with OPTIMIZE, ZORDER, and VACUUM operations and design a Fabric Warehouse schema in T-SQL to support star-schema analytics and incremental loads. By the end, you’ll have practical experience building optimized Lakehouse and Warehouse solutions and the core data engineering skills required for enterprise Fabric implementations.

Syllabus

  • Implementing Medallion Architecture
    • Implement the Medallion pattern with progressive data refinement from raw (bronze) to analytics-ready (gold).
  • Tracing Lineage in Microsoft Fabric
    • Use Fabric lineage views to understand how Fabric items such as Lakehouses, notebooks, pipelines, semantic models, and reports connect across a Medallion architecture.
  • Ingestion Methods and Delta Table Types
    • Compare ingestion methods (upload, pipelines, Copy Jobs, notebooks) and understand managed vs. unmanaged Delta table implications.
  • Reading Data with SQL Endpoint and Notebooks
    • Master both SQL and programmatic approaches to reading Lakehouse data.
  • Delta Lake Transactions and MERGE Operations
    • Learn how ACID properties work in Delta Lake and implement transactional MERGE operations for upserts.
  • Time-Travel Queries for Historical Analysis
    • Use Delta Lake's time-travel feature to query historical versions of tables for audit, debugging, and compliance.
  • Delta Table Optimization
    • Diagnose performance problems in Delta tables and apply optimization techniques with measurable results.
  • Managing Storage with VACUUM
    • Remove obsolete Delta files to control storage costs while preserving time-travel capability.
  • Designing Star-Schema Warehouses
    • Create Fabric Warehouse schemas optimized for analytical queries using star-schema design patterns.
  • Warehouse Mirroring
    • Understand mirroring options for near real-time replication from operational systems.
  • Data Storage & Processing Pipeline Project
    • Build and document a production-ready data storage and processing solution using Medallion architecture, Delta Lake optimization, and star-schema Warehouse design.

Taught by

Microsoft

Reviews

Start your review of Data Storage & Processing

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.