YoVDO

Serverless Data Processing with Dataflow - Testing with Apache Beam (Java)

Offered By: Google via Google Cloud Skills Boost

Tags

Dataflow Courses Java Courses Unit Testing Courses Apache Beam Courses Stream Processing Courses Serverless Data Processing Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
In this lab you will learn and implement testing concepts for Cloud Dataflow.

Syllabus

  • Overview
  • Setup and requirements
  • Lab part 1. Performing unit tests for DoFns and PTransforms
  • Task 1. Explore the main pipeline code
  • Task 2. Add dependencies for testing
  • Task 3. Write first DoFn unit test in Apache Beam
  • Task 4. Run first DoFn unit test
  • Task 5. Run second DoFn unit test and debug pipeline
  • Task 6. Run PTransform unit test and test end-to-end pipeline
  • Lab part 2. Testing stream processing logic with TestStream
  • Task 1. Explore the main pipeline code
  • Task 2. Explore TestStream usage and run first test
  • Task 3. Create TestStream to test late data handling
  • Task 4. Run test for late data handling
  • End your lab

Tags

Related Courses

Ruby on Rails: An Introduction
Johns Hopkins University via Coursera Internet of Things Capstone: Build a Mobile Surveillance System
University of California, San Diego via Coursera Engineering Maintainable Android Apps
Vanderbilt University via Coursera Orientação a Objetos com Java
Instituto Tecnológico de Aeronáutica via Coursera TDD – Desenvolvimento de Software Guiado por Testes
Instituto Tecnológico de Aeronáutica via Coursera