FinOps - Automated Unity Catalog Cost Observability, Data Isolation and Governance Framework

Learn how to implement a comprehensive FinOps framework for Databricks Unity Catalog through this 18-minute conference talk that demonstrates Westat's approach to automated cost observability, data isolation, and governance. Discover how a leading data research organization modernized their technical infrastructure to support hundreds of government, foundation, and private client projects while maintaining rigorous statistical standards and regulatory compliance. Explore the implementation of config-driven Infrastructure as Code (IaC) using Terragrunt, custom tagging strategies integrated with AWS cost management for ROI tracking, and budget policies with proactive alerts for cost management. Examine the development of isolated project environments with strict data boundaries, centralized oversight capabilities, and project-specific customization options for compute and analytics resources. Understand how to build a centralized dashboard with row-level security that enables self-service cost analytics while providing full financial visibility and governance across data teams. Gain insights into scalable computing solutions for complex analyses and learn practical strategies for delivering unified governance that empowers data teams to deliver value while maintaining cost control and compliance requirements.