Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

LinkedIn Learning

Stream Processing Design Patterns with Kafka Streams

via LinkedIn Learning

Go to class Write review
Datacamp Ad

PowerBI Data Analyst - Create visualizations and dashboards from scratch

Learn More → OpenLearning Ad

50% OFF: In-Depth AI & Machine Learning Course

Learn More →

Overview

Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Upskill as a data professional by learning how to build streaming pipelines using Snowflake, Kafka, and AWS.

Syllabus

Introduction
  • Building streaming data pipelines
  • What you should know
  • Prerequisites
1. Introduction to Data Streaming, AWS, and Snowflake
  • Why AWS and Snowflake?
  • Introduction to streaming ingestion pipelines
  • Streaming data pipelines: A deeper dive
  • Overview of streaming pipeline project
2. Building a Streaming Pipeline
  • Setting up your MSK cluster and EC2 instance
  • Setting up your keys
  • What is Snowpipe?
  • Installing Snowpipe Kafka connector
  • Set up config for provider-MSK connection and create topic
  • Preparing your Snowflake environment
  • Setting up your Snowpipe Kafka connect config
  • Sending data to Snowflake
  • Final considerations
Conclusion
  • Course review and next steps

Taught by

Kumaran Ponnambalam

Reviews

4.8 rating at LinkedIn Learning based on 28 ratings

Start your review of Stream Processing Design Patterns with Kafka Streams

Go to class

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free
Someone learning on their laptop while sitting on the floor.