Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Data Engineering Foundations

via LinkedIn Learning

Go to class Write review

Coursera

Save 43% on 1 Year of Coursera Plus

OpenLearning

Future-Proof Your Career: AI Manager Masterclass

Overview

Coursera Flash Sale

40% Off Coursera Plus for 3 Months!

Learn the key facets of data engineering, from its place in the data science realm, to the specific tasks and skills every data engineer should possess.

Syllabus

Introduction

What is data engineering?

1. Introduction to Data Engineering

Introduction to data engineering
Data engineer vs. data scientist
Essential tools for data engineering

2. Databases and Dataframes

Intro to databases and their types
Understanding database schema
Distributive computing

3. Data Engineering Tools

MapReduce and Hadoop
Hive
Spark
Airflow

4. ETL Pipelines

Sources of data extraction
Data extraction from a PostgreSQL database
Challenge: Data extraction
Solution: Data extraction
Transforming data
Challenge: Transforming data
Solution: Transforming data
Loading data into a DB
Challenge: Loading data
Solution: Loading data
Scheduling ETL pipeline using Airflow

Conclusion

Next steps

Taught by

Harshit Tyagi

Reviews

4.7 rating at LinkedIn Learning based on 3579 ratings

Start your review of Data Engineering Foundations