Transforming Apache Kafka into a Scalable Message Queue - OPN413
AWS Events via YouTube
-
11
-
- Write review
Become an AI & ML Engineer with Cal Poly EPaCE — IBM-Certified Training
Learn AI, Data Science & Business — Earn Certificates That Get You Hired
Overview
Google, IBM & Meta Certificates – 40% Off
One plan covers every Professional Certificate on Coursera.
Unlock All Certificates
Learn how to transform Apache Kafka from an event streaming platform into a scalable message queue using KIP-932's share groups feature in this 51-minute conference talk from AWS re:Invent 2025. Discover how share groups enable consumers to cooperatively consume data from Kafka topics with queue-like semantics, allowing for per-message acknowledgment, retries, and load distribution without the complexities of traditional partition management. Explore how this approach prioritizes parallel consumption over strict ordering, making it ideal for workloads involving independent work items. Understand the benefits of implementing queuing semantics in Kafka to simplify message handling, enhance scalability, and create more flexible, efficient processing in event-driven architectures. Gain insights into when and how to leverage this feature to optimize your Apache Kafka deployments for scenarios where traditional event streaming patterns may not be the best fit.
Syllabus
AWS re:Invent 2025 - Transforming Apache Kafka into a Scalable Message Queue (OPN413)
Taught by
AWS Events