Data - The Land DevOps Forgot

Explore how modern organizations can transform their data processing approach from centralized monolithic systems to decentralized data mesh architectures in this 33-minute conference talk from GOTO Copenhagen 2024. Learn why traditional analytics processing creates bottlenecks that contradict DevOps principles, running monolithic batches for hours on hundreds of cores with slow feedback cycles that centralized data teams struggle to manage. Discover the data mesh paradigm as a solution that re-decentralizes data processing along with ownership, applying product thinking to internal data products and enabling stream-aligned teams to maintain control over their data. Understand the practical aspects of implementing data mesh including what technologies you can purchase versus what you'll need to build internally, strategies for gaining organizational buy-in for the transformation, and how to support data owners effectively. Examine how platforms can create proper incentives for adoption and learn techniques for making the business need for change visceral to stakeholders. Gain insights into moving beyond the operational versus analytical divide that has left data as "the land DevOps forgot" and discover how to apply DevOps principles to data processing for faster, safer, and more responsive analytics workflows.