Taming the Data Mess - Navigating and Managing Complex Data Landscapes

Watch a 46-minute conference talk exploring strategies for navigating the complex data engineering landscape, where Ismaël Mejía shares technical and organizational approaches to handle the current fragmented state of data engineering. Learn about key concepts including streaming data, data mesh architectures, cloud data platforms, modern data stacks, and machine learning systems while gaining insights into effective decision-making processes. Discover practical approaches to experimentation, risk planning, and stakeholder management, along with guidance on building data-driven cultures, managing tradeoffs, and implementing compliance training. Gain valuable perspectives on the importance of diversity, decentralization, and domain knowledge in data engineering, with emphasis on treating data as a crucial organizational asset that requires careful consideration of both technical and human factors.