Understanding Modern Data Architecture

Overview

DataCamp Flash Sale:

50% Off - Build Data and AI Skills!

Grab it

Discover modern data architecture's key components, from ingestion and serving to governance and orchestration.

Introduction to modern data architectures

The world is constantly changing thanks to data, and every day the amount of data to be processed is even bigger. Thus, this course gives you an overview of modern data architectures, guiding you through the fundamental components of data solutions.

Components of modern data architectures

This is an introductory course to modern data solutions. During the first half of this course you'll learn what modern data architectures are, will review some popular solutions like Data Mesh and Data Fabric, and will explore the different elements of data architectures such as storage, data ingestion methods, processing options, and serving techniques.

Transversal Components of modern data architectures

In the second half, the course shows the transversal components that ensure the cohesion and enable the management of data architectures; explaining concepts like data governance, orchestration, observability, and even cost optimization within cloud providers. With all these elements, you'll be able to design data solutions that highly align with your organization's needs.

Designing and evaluating modern data architectures

The final part of the course integrates the knowledge you've gained, using a business case to design a data solution that satisfies the requirements of the business.

Syllabus

Introduction to Modern Data Architecture

After seeing this chapter, you will be able to explain what modern data architecture is, and what are their key requirements and components. You'll also review different types of existing data architectures, ranging from Lambda to Data Mesh.

Modern Data Architecture Components

Learn about the different components and layers of modern data architectures; from data ingestion to serving. Get familiar with the different paradigms and approaches in each layer, and some of the cloud services used to implement modern data solutions to get field experience!

Transversal Components of Data Architectures

Dive into the transversal components that modern data architectures consist of, covering key aspects like data governance, metadata, data security, and observability. By understanding these vital elements, you'll be prepared to design robust, secure, and efficient data platforms while maintaining high standards for the data and overall service.

Putting it All Together

Learn how to manage workflows, understand costs in cloud services, and create modern data designs. This chapter helps you work with tools like Apache Airflow and teaches you ways to save money on cloud use. By the end, you'll know how to build and judge strong data systems for businesses.