Google, IBM & Meta Certificates — All 10,000+ Courses at 40% Off
One annual plan covers every course and certificate on Coursera. 40% off for a limited time.
Get Full Access
Learn how to build a config-driven data pipeline framework that dramatically reduces engineering overhead in this 39-minute conference talk from Databricks. Discover the challenges of managing business intelligence with contributions from hundreds of product engineering teams while maintaining central oversight and quality. Explore how Databricks developed a solution using Metric Store and UC Metrics that enabled two platform engineers to accomplish the work traditionally requiring 100 classical data engineers. Understand the strategies for keeping pace with rapid business changes that demand constant updates to data pipelines, and see how a federated approach can help your data engineering team manage complexity more effectively. Gain insights into building scalable data infrastructure that supports distributed teams while ensuring data quality and governance standards across your organization.
