Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Unlock Your Use Cases - A Deep Dive on Structured Streaming's New TransformWithState API

Databricks via YouTube

Overview

Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Explore Spark Structured Streaming's revolutionary TransformWithState API through a comprehensive 38-minute conference talk that transforms how you approach complex streaming use cases. Learn to implement previously impossible data processing scenarios using arbitrary stateful operations, moving beyond the limitations that force you to tell customers "no" to their data requirements. Master real-world applications through step-by-step demonstrations covering state variables, process versus event time handling, watermarks implementation, timer management, and state TTL configuration. Discover advanced techniques for initializing state using checkpoints from other streams, enabling sophisticated streaming architectures. Gain practical expertise in building production-ready streaming solutions that unlock new possibilities for rapid data delivery and complex logic implementation. Presented by Databricks experts Angela Chu (Lead Solutions Architect) and Anish Shrigondekar (Software Engineer), this deep dive equips you with the knowledge to leverage Structured Streaming's most powerful new feature for solving challenging real-time data processing requirements.

Syllabus

Unlock Your Use Cases: A Deep Dive on Structured Streaming’s New TransformWithState API

Taught by

Databricks

Reviews

Start your review of Unlock Your Use Cases - A Deep Dive on Structured Streaming's New TransformWithState API

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.