Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Data Pipeline Automation on AWS

Go to class Write review

Overview

Automate data workflows on AWS using Lambda and EventBridge. Build serverless functions that trigger on S3 uploads, run on schedules, and launch Glue ETL jobs—creating an end-to-end pipeline that processes files automatically without manual intervention.

Syllabus

Unit 1: Getting Started with Lambda

Adding Timestamps to Lambda Functions
Adding Multilingual Support to Lambda Functions
Deploying Lambda Functions with AWS CLI
Validating User Data in Lambda Functions

Unit 2: Reacting to S3 Events

Extracting Filenames from S3 Events
Logging S3 Upload Events with Lambda
Filtering S3 Events with Conditional Logic
Configuring S3 Event Notifications

Unit 3: Triggering Glue Jobs with Lambda

Initialize Your First Glue Client
Extract S3 Event Information in Lambda
Start Your First Glue Job Run
Pass File Details to Glue Job

Unit 4: Scheduling Lambda Functions

Adjusting EventBridge Schedule Frequency
Creating Your First EventBridge Rule
Fixing EventBridge Permission Configuration Bug
Connecting Lambda Functions to EventBridge Rules

Reviews

Start your review of Data Pipeline Automation on AWS