Overview
Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Learn how LinkedIn implemented ViewShift, a robust dynamic policy enforcement engine integrated within its data lake architecture, in this 18-minute conference talk from Databricks. Discover how catalogs can automatically route table resolutions to compliance-enforcing SQL views that are auto-generated from declarative data annotations, honor user-level consent and preferences, apply context-aware transformations for specific use cases, and remain portable across all engines despite being implemented in a single SQL dialect. Explore LinkedIn's query engine stack and understand how ViewShift ensures compliance is seamlessly integrated into data processing workflows, addressing the critical need for dynamic policy enforcement in today's data compliance-focused landscape where companies, individuals, and regulators prioritize data governance.
Syllabus
ViewShift: Dynamic Policy Enforcement With Spark and SQL Views
Taught by
Databricks