Lead AI Strategy with UCSB's Agentic AI Program — Microsoft Certified
MIT Sloan AI Adoption: Build a Playbook That Drives Real Business ROI
Overview
Google, IBM & Meta Certificates — All 10,000+ Courses at 40% Off
One annual plan covers every course and certificate on Coursera. 40% off for a limited time.
Get Full Access
Upskill as a data professional by learning how to build streaming pipelines using Snowflake, Kafka, and AWS.
Syllabus
Introduction
- Building streaming data pipelines
- What you should know
- Prerequisites
- Why AWS and Snowflake?
- Introduction to streaming ingestion pipelines
- Streaming data pipelines: A deeper dive
- Overview of streaming pipeline project
- Setting up your MSK cluster and EC2 instance
- Setting up your keys
- What is Snowpipe?
- Installing Snowpipe Kafka connector
- Set up config for provider-MSK connection and create topic
- Preparing your Snowflake environment
- Setting up your Snowpipe Kafka connect config
- Sending data to Snowflake
- Final considerations
- Course review and next steps
Taught by
Kumaran Ponnambalam