Petabyte Scale Logging with Fluentd and Fluent Bit - A Use Case From Intuit

This session presents an Intuit use case for scaling logging in Kubernetes clusters. It covers Fluentd and Fluent Bit configuration for buffering through network outages, managing backpressure, and avoiding common troubleshooting mistakes.

Syllabus

Introduction
What is Fluentd
Challenges for Scale Logging
Fluentd Fluent Bit
Architecture Patterns
Use Case
Log Transport
Challenges
Architecture
Offloading
Cost Breakdown
Test Cluster
Test Results
Summary