Unlock Your Use Cases - A Deep Dive on Structured Streaming's New TransformWithState API
Databricks via YouTube
Overview
Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Explore Spark Structured Streaming's revolutionary TransformWithState API through a comprehensive 38-minute conference talk that transforms how you approach complex streaming use cases. Learn to implement previously impossible data processing scenarios using arbitrary stateful operations, moving beyond the limitations that force you to tell customers "no" to their data requirements. Master real-world applications through step-by-step demonstrations covering state variables, process versus event time handling, watermarks implementation, timer management, and state TTL configuration. Discover advanced techniques for initializing state using checkpoints from other streams, enabling sophisticated streaming architectures. Gain practical expertise in building production-ready streaming solutions that unlock new possibilities for rapid data delivery and complex logic implementation. Presented by Databricks experts Angela Chu (Lead Solutions Architect) and Anish Shrigondekar (Software Engineer), this deep dive equips you with the knowledge to leverage Structured Streaming's most powerful new feature for solving challenging real-time data processing requirements.
Syllabus
Unlock Your Use Cases: A Deep Dive on Structured Streaming’s New TransformWithState API
Taught by
Databricks