Google, IBM & Meta Certificates — 40% Off for a Limited Time
Learn the Skills Netflix, Meta, and Capital One Actually Hire For
Overview
Google, IBM & Meta Certificates — All 10,000+ Courses at 40% Off
One annual plan covers every course and certificate on Coursera. 40% off for a limited time.
Get Full Access
Explore open-source solutions for ensuring data quality in continuous import scenarios in this 28-minute presentation from Databricks. Compare popular options like Apache Griffin, Deequ, DDQ, and Great Expectations across dimensions such as maturity, documentation, extensibility, and features including data profiling and anomaly detection. Learn about various data quality approaches, tools, and frameworks, including ETL processes, quality checks, code generation, and advanced uniqueness checks. Gain insights into the limitations of Apache Griffin and discover how to implement timely data quality assurance in your organization's data pipeline.
Syllabus
Intro
Data Quality
ETL Process
Quality Checks
Data Quality Approaches
Data Quality Tools
Deku
Code Generation
Great Expectations
Pandas Profiling
Apache Griffin
Apache Griffin Limitations
Examples
Uniqueness checks
Advanced checks
Timely data
Other frameworks
Taught by
Databricks