Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Learn how Lakeflow Connect revolutionizes complex event-driven architectures through this 25-minute conference talk from the Data&AI Summit 2021. Discover how Delaware's European Food Safety Authority (EFSA) initially implemented a state-of-the-art event-driven architecture in 2020, creating a highly decoupled system landscape that enabled near real-time event brokering and instant consumer application reactions through publisher/subscriber mechanisms. Explore the challenges encountered with this custom event processing approach, including incomplete edge case coverage, suboptimal data quality due to missing events, and the need for complex logic to create SCD2 tables. Understand how Lakeflow Connect addresses these limitations by enabling direct data extraction from sources, eliminating complex intermediate architectures, preventing data loss, and automatically creating SCD2 tables with simple adjustments. Gain insights into creating more efficient and intelligent data provisioning systems from cloud solutions architect Giancarlo Costa, business analyst Jeroen De Clercq, and senior consultant Tim Bal as they share practical lessons learned from transitioning from traditional event-driven architectures to Lakeflow Connect implementation.
