Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Unit Tests - Overcoming Challenges in Structured Streaming

Databricks via YouTube

Overview

Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Explore strategies for overcoming challenges in unit testing structured streaming jobs in this 31-minute conference talk by Bartosz Konieczny, a freelance data engineer. Learn how to improve control over your codebase and increase confidence in your CI/CD pipeline releases. Discover solutions to common pain points data engineers face when writing unit tests for streaming jobs, including how to control assertions for long-running processes and represent third-party data stores and APIs in code. While focused on streaming jobs, gain insights applicable to batch pipelines as well. Enhance your data quality and processing layer through improved unit testing techniques for data engineering projects.

Syllabus

Unit Tests: How to Overcome Challenges in Structured Streaming

Taught by

Databricks

Reviews

Start your review of Unit Tests - Overcoming Challenges in Structured Streaming

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.