Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Distributed Tracing with ClickHouse and OpenTelemetry

Altinity via YouTube

Overview

Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Explore the inner workings of distributed databases through this comprehensive 56-minute webinar that demonstrates how to implement distributed tracing with ClickHouse and OpenTelemetry. Dive deep into analyzing the internal operations of various ClickHouse clusters while executing different types of queries, gaining insights into what happens behind the scenes when you run database operations. Learn to leverage OpenTelemetry and eBPF-based tools to observe queries entering ClickHouse with full context from client applications, enabling you to create comprehensive end-to-end traces that provide complete visibility into your distributed system. Discover how ClickHouse can serve as a versatile storage layer for trace data and connect your ClickHouse data to popular visualization tools like Jaeger and Grafana for enhanced observability. The session includes two hands-on demonstrations: first showing traces implementation with ClickHouse and OpenTelemetry, followed by exploring built-in observability features including metrics, logs, and traces. Address practical concerns through an extensive Q&A session covering topics such as managing data partitioning, handling high-throughput applications with 20k RPS, managing cardinality challenges, schema optimization for OpenTelemetry data, and future native configuration options for trace export.

Syllabus

25:16 Demo #1: Traces with ClickHouse + OpenTelemetry
40:11 Demo #2: Observability for ClickHouse: Built-in metrics, logs, and traces
46:45 How do we make sure not to create too many small parts? Any config parameter to set?
49:34 How do you handle traces with an app with 20k RPS server? Can I just enable traces for errors only?
50:50 We are concerned about cardinality but from your talk it seems Clickhouse can handle it. 1 Can you explain a little more how it is able to do it? 2 If we do hit ClickHouse cardinality issue and need to split, any suggestions on how/what fields to do it on? Timestamps?
53:03 If I send metrics from the collector to ClickHouse without changes, is the default schema good enough?
54:04 Is there a ClickHouse schema that matches semantic conventions?
55:09 Will there be a native config to export Otel traces instead of a URL table?

Taught by

Altinity

Reviews

Start your review of Distributed Tracing with ClickHouse and OpenTelemetry

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.