Serverless Data Processing with Dataflow - Testing with Apache Beam (Java)

Offered By: Google via Google Cloud Skills Boost

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!

Grab it

In this lab you will learn and implement testing concepts for Cloud Dataflow.

Syllabus

• Overview
• Setup and requirements
• Lab part 1. Performing unit tests for DoFns and PTransforms
• Task 1. Explore the main pipeline code
• Task 2. Add dependencies for testing
• Task 3. Write first DoFn unit test in Apache Beam
• Task 4. Run first DoFn unit test
• Task 5. Run second DoFn unit test and debug pipeline
• Task 6. Run PTransform unit test and test end-to-end pipeline
• Lab part 2. Testing stream processing logic with TestStream
• Task 1. Explore the main pipeline code
• Task 2. Explore TestStream usage and run first test
• Task 3. Create TestStream to test late data handling
• Task 4. Run test for late data handling
• End your lab

Tags

• united states