StreamNative Courses

High-Throughput Streaming in Lakehouse with Non-Blocking Concurrency Control in Apache Flink and Hudi

Explore Apache Hudi's Non-Blocking Concurrency Control for conflict-free streaming ingestion with Flink, enabling high-throughput real-time data processing and eliminating write bottlenecks.

• YouTube
• 40 minutes
• On-Demand
• Free Video

Goodbye Distributed Locks - Message Orchestration at Scale with Apache Pulsar

Discover how Attentive evolved from Redis locks to Apache Pulsar's subscription modes for mutual exclusivity, scaling to 3.9B messages during peak events like Black Friday.

• YouTube
• 24 minutes
• On-Demand
• Free Video

Processing 1M Identity Graphs per Second with Spark Structured Streaming

Discover how Adobe scales identity graph processing to handle 1M+ records per second using Spark Structured Streaming and Delta Lake, achieving 10x pipeline growth with optimized performance.

• YouTube
• 31 minutes
• On-Demand
• Free Video

Melting Icebergs - Enabling Analytical Access to Kafka Data through Iceberg Projections

Discover how to bridge operational and analytical data by creating Iceberg-compatible projections of Kafka data, eliminating ETL processes while maintaining performance.

• YouTube
• 43 minutes
• On-Demand
• Free Video

Flink Changelog Modes and Why You Should Care About Them

Discover how Flink's changelog modes impact state size, latency, and performance through SQL examples and operator topology analysis to optimize your data pipelines.

• YouTube
• 27 minutes
• On-Demand
• Free Video

Anomaly Detection in Network Logs Using Generalized Isolation Forest and ExIFFI

Discover advanced anomaly detection in network logs using Generalized Isolation Forest and ExIFFI for enhanced cybersecurity with real-time processing and explainable AI insights.

• YouTube
• 33 minutes
• On-Demand
• Free Video

Unlock Next-Gen Stateful Streaming in Apache Spark with transformWithState and Streaming Platforms

Discover Apache Spark's transformWithState operator for building sophisticated, low-latency streaming applications with real-time fraud detection and session analytics examples.

• YouTube
• 27 minutes
• On-Demand
• Free Video

Streaming with Iceberg - From Zero to Hero

Master streaming data into Iceberg with advanced techniques for managing small files, optimizing compaction strategies, and building efficient real-time pipelines.

• YouTube
• 29 minutes
• On-Demand
• Free Video

Real-Time Data, Real Problems - Using Pulsar Schemas for Data Governance

Discover how Pulsar schemas solve real-time data consistency issues, enforce governance, and enable smooth schema evolution to prevent breaking changes in streaming systems.

• YouTube
• 26 minutes
• On-Demand
• Free Video

Apache Kafka API - The Unofficial Standard for Streaming?

Explore the challenges of implementing Kafka API compatibility in streaming platforms and discover how Apache Pulsar offers architectural flexibility while maintaining ecosystem integration.

• YouTube
• 32 minutes
• On-Demand
• Free Video

Efficient Kafka Topic Compaction at Scale on Ursa

Explore advanced topic compaction techniques on Ursa, a leaderless S3-based Kafka server that balances storage costs with efficiency for scalable cloud-native streaming.

• YouTube
• 25 minutes
• On-Demand
• Free Video

Real-Time Data Processing and Analysis in Capital Markets

Discover how to build scalable real-time data pipelines for capital markets using SQL-based analytics to process trade events, detect anomalies, and enable high-frequency trading decisions.

• YouTube
• 29 minutes
• On-Demand
• Free Video

Avro, Arrow, Protobuf, Parquet and Why - Data Serialization Formats for Streaming

Explore data serialization formats beyond JSON to optimize streaming performance, manage schemas effectively, and enhance data processing efficiency in modern systems.

• YouTube
• 42 minutes
• On-Demand
• Free Video

Oxia for Data Streaming - Striking the Perfect Balance of Scalability, Latency, and Cost

Discover how Oxia transforms data streaming by serving as both metadata system and index storage engine, optimizing scalability, latency, and cost efficiency for high-throughput pipelines.

• YouTube
• 28 minutes
• On-Demand
• Free Video

Integrating StreamNative's Ursa Engine with PuppyGraph for Real-Time Graph Analysis

Discover how StreamNative's Ursa Engine integrates with PuppyGraph to enable real-time graph analytics on streaming data without dedicated graph databases using Gremlin and openCypher.

• YouTube
• 28 minutes
• On-Demand
• Free Video