AI, Data Science & Cloud Certificates from Google, IBM & Meta — 40% Off
One plan covers every Professional Certificate on Coursera. 40% off Coursera Plus Annual.
Unlock All Certificates
Learn how to build a config-driven data pipeline framework that dramatically reduces engineering overhead in this 39-minute conference talk from Databricks. Discover the challenges of managing business intelligence with contributions from hundreds of product engineering teams while maintaining central oversight and quality. Explore how Databricks developed a solution using Metric Store and UC Metrics that enabled two platform engineers to accomplish the work traditionally requiring 100 classical data engineers. Understand the strategies for keeping pace with rapid business changes that demand constant updates to data pipelines, and see how a federated approach can help your data engineering team manage complexity more effectively. Gain insights into building scalable data infrastructure that supports distributed teams while ensuring data quality and governance standards across your organization.
