Gain a Splash of New Skills - Coursera+ Annual Just ₹7,999
Learn Backend Development Part-Time, Online
Overview
Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Explore a pioneering approach to achieving sub-2 second end-to-end latency in streaming data processing through this 18-minute conference talk. Learn how to build low-latency streaming ETL pipelines using Apache Spark Structured Streaming combined with next-generation OLTP database solutions. Discover the advanced optimization techniques and best practices that enable seamless ingestion of streaming data from Kinesis and efficient merging into OLTP databases, as validated in real customer scenarios. Understand how this breakthrough architecture enhances performance and scalability while providing a replicable blueprint for transforming data pipelines across various industry verticals. Gain insights into how next-generation solutions can revolutionize real-time data processing and unlock new use cases in the modern data landscape, with practical applications for delivering exceptional user experiences and reducing total cost of ownership in today's digital economy.
Syllabus
Race to Real-Time: Low-Latency Streaming ETL With Next-Gen OLTP-DB
Taught by
Databricks