Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Data Engineering Project: Build Streaming Ingestion Pipelines for Snowflake with AWS

via LinkedIn Learning

Write review

Scrimba

Free courses from frontend to fullstack and AI

Babbel

Start speaking a new language. It’s just 3 weeks away.

Overview

Google, IBM & Meta Certificates – 40% Off

One plan covers every Professional Certificate on Coursera.

Unlock All Certificates

Upskill as a data professional by learning how to build streaming pipelines using Snowflake, Kafka, and AWS.

Syllabus

Introduction

Building streaming data pipelines
What you should know
Prerequisites

1. Introduction to Data Streaming, AWS, and Snowflake

Why AWS and Snowflake?
Introduction to streaming ingestion pipelines
Streaming data pipelines: A deeper dive
Overview of streaming pipeline project

2. Building a Streaming Pipeline

Setting up your MSK cluster and EC2 instance
Setting up your keys
What is Snowpipe?
Installing Snowpipe Kafka connector
Set up config for provider-MSK connection and create topic
Preparing your Snowflake environment
Setting up your Snowpipe Kafka connect config
Sending data to Snowflake
Final considerations

Conclusion

Course review and next steps

Taught by

Kumaran Ponnambalam

Reviews

4.6 rating at LinkedIn Learning based on 74 ratings

Start your review of Data Engineering Project: Build Streaming Ingestion Pipelines for Snowflake with AWS