Troubleshooting and Debugging Kafka

Introduction

• Overview of troubleshooting and debugging Kafka

1. Introducing Cloud-Native Kafka on Confluent

• Prerequisites
• An overview of Apache Kafka
• The Confluent platform
• Downloading the Confluent platform binaries
• Running the Confluent platform locally
• Overview of the control center

2. Observing Consumers and Brokers

• Observing message production and consumption
• Produce messages using the control center
• Using datagen to generate synthetic data
• Observing consumers

3. Processing Kafka Streams

• Understanding ksqlDB
• Creating streams and tables using ksqlDB
• Performing join and windowing operations
• Viewing streams and tables

4. Monitoring Consumer Groups

• Programmatically produce messages using Python
• Troubleshooting partition usage
• Consumer groups
• Monitoring consumption in a consumer group
• Debugging consumption lag
• Monitoring consumer group rebalancing

5. Monitoring Multi-Broker Clusters

• Configuration properties for a multi-broker cluster
• Running a multi-broker cluster on the Confluent platform
• Monitoring brokers
• Observing partitions and replication
• Monitoring broker throughput and latency

6. Debugging Brokers and Consumers

• Debugging failed brokers, part 1
• Debugging failed brokers, part 2
• Debugging slow consumers

7. Configuring Alerts

• Configuring alerts
• Configuring email settings for alerts

Conclusion

• Summary and next steps