How Duolingo Plans to Reach 100M Users

Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Google

Serverless Data Processing with Dataflow - Testing with Apache Beam (Java)

Google via Google Skills

Go to class Write review
Corporate Finance Institute Ad

Build the Finance Skills That Lead to Promotions — Not Just Certificates

Learn More → Simplilearn Ad

Become an AI & ML Engineer with Cal Poly EPaCE — IBM-Certified Training

Learn More →

Overview

Syllabus

  • Overview
  • Setup and requirements
  • Lab part 1. Performing unit tests for DoFns and PTransforms
  • Task 1. Explore the main pipeline code
  • Task 2. Add dependencies for testing
  • Task 3. Write first DoFn unit test in Apache Beam
  • Task 4. Run first DoFn unit test
  • Task 5. Run second DoFn unit test and debug pipeline
  • Task 6. Run PTransform unit test and test end-to-end pipeline
  • Lab part 2. Testing stream processing logic with TestStream
  • Task 1. Explore the main pipeline code
  • Task 2. Explore TestStream usage and run first test
  • Task 3. Create TestStream to test late data handling
  • Task 4. Run test for late data handling
  • End your lab

Tags

Reviews

Start your review of Serverless Data Processing with Dataflow - Testing with Apache Beam (Java)

Go to class

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free
Someone learning on their laptop while sitting on the floor.