Decoding OpenTelemetry Collector - A Deep Dive into Architecture

Explore the intricate architecture of the OpenTelemetry (OTel) Collector in this 26-minute conference talk that reveals the internal workings of this vendor-neutral observability agent. Discover the componentized architecture that forms the backbone of modern observability pipelines and learn how it transforms infrastructure and application monitoring. Examine the many documented and undocumented components and APIs that comprise the OTel Collector, including lesser-known extensions, connectors, providers, and converters that extend its capabilities beyond the standard configuration. Understand the fundamental data flow mechanisms within the Collector, particularly focusing on the essential but often overlooked 'exporthelper' component that manages queueing, batching, and data persistence. Gain insights from real-world experience of rolling out Collector builds at scale, contributing to the project, and working with customers to implement robust observability solutions. Learn troubleshooting strategies and architectural principles that will help you optimize your observability pipeline and resolve issues when they arise in production environments.