Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Google

Serverless Data Processing with Dataflow - Testing with Apache Beam (Java)

Google via Google Skills

Go to class Write review
Coursera Ad

AI, Data Science & Cloud Certificates from Google, IBM & Meta

Learn More → DataCamp Ad

Power BI Fundamentals - Create visualizations and dashboards from scratch

Learn More →

Overview

Build a Learning Habit
Download Class Central's free printable study calendar
Download for Free
In this lab you will learn and implement testing concepts for Cloud Dataflow.

Syllabus

  • Overview
  • Setup and requirements
  • Lab part 1. Performing unit tests for DoFns and PTransforms
  • Task 1. Explore the main pipeline code
  • Task 2. Add dependencies for testing
  • Task 3. Write first DoFn unit test in Apache Beam
  • Task 4. Run first DoFn unit test
  • Task 5. Run second DoFn unit test and debug pipeline
  • Task 6. Run PTransform unit test and test end-to-end pipeline
  • Lab part 2. Testing stream processing logic with TestStream
  • Task 1. Explore the main pipeline code
  • Task 2. Explore TestStream usage and run first test
  • Task 3. Create TestStream to test late data handling
  • Task 4. Run test for late data handling
  • End your lab

Tags

Reviews

Start your review of Serverless Data Processing with Dataflow - Testing with Apache Beam (Java)

Go to class

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free
Someone learning on their laptop while sitting on the floor.