Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Google

Serverless Data Processing with Dataflow - Testing with Apache Beam (Java)

Google via Google Skills

Go to class Write review
Coursera Ad

Gain a Splash of New Skills - Coursera+ Annual Just ₹7,999

Learn More → Corporate Finance Institute Ad

Master Finance Tools - 35% Off CFI (Code CFI35)

Learn More →

Overview

Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
In this lab you will learn and implement testing concepts for Cloud Dataflow.

Syllabus

  • Overview
  • Setup and requirements
  • Lab part 1. Performing unit tests for DoFns and PTransforms
  • Task 1. Explore the main pipeline code
  • Task 2. Add dependencies for testing
  • Task 3. Write first DoFn unit test in Apache Beam
  • Task 4. Run first DoFn unit test
  • Task 5. Run second DoFn unit test and debug pipeline
  • Task 6. Run PTransform unit test and test end-to-end pipeline
  • Lab part 2. Testing stream processing logic with TestStream
  • Task 1. Explore the main pipeline code
  • Task 2. Explore TestStream usage and run first test
  • Task 3. Create TestStream to test late data handling
  • Task 4. Run test for late data handling
  • End your lab

Tags

Reviews

Start your review of Serverless Data Processing with Dataflow - Testing with Apache Beam (Java)

Go to class

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free
Someone learning on their laptop while sitting on the floor.