AI, Data Science & Cloud Certificates from Google, IBM & Meta
Learn Backend Development Part-Time, Online
Overview
Google, IBM & Meta Certificates – 40% Off
One Coursera Plus subscription covers most Professional Certificates on Coursera.
Unlock All Certificates
This talk explains how Apache Kafka extends at-least-once delivery toward exactly-once semantics using idempotent producers and transactions. It covers transaction protocols, state replication, failure scenarios, consumer isolation, performance, and future improvements for stream processing.
Syllabus
Intro
KAFKA IN A HURRY
KAFKA PRODUCER
PRODUCER PROTOCOL
KAFKA CONSUMER
CONSUMER PROTOCOL
PROCESSING MODEL
PROCESSING SEMANTICS
AT-LEAST-ONCE SEMANTICS
SEMANTIC WEAKNESSES
IDEMPOTENT PRODUCER
CHANDY-LAMPORT SNAPSHOTS
KAFKA TRANSACTIONS
TRANSACTION LOG AVAILABILITY
ZOMBIE FENCING
CONSUMER READ ISOLATION
BROKER FETCH HANDLING
CONSUMER FETCH HANDLING
CONCURRENT TRANSACTIONS
KAFKA EXACTLY ONCE SEMANTICS
PERFORMANCE OBSERVATIONS
END-TO-END EOS
FUTURE IMPROVEMENTS
EOS TEAM
APACHE KAFKA
Taught by
Strange Loop Conference