Building Advanced Codeless Pipelines on Cloud Data Fusion

This advanced-level Quest builds on its predecessor Quest, and offers hands-on practice on the more advanced data integration features available in Cloud Data Fusion, while sharing best practices to build more robust, reusable, dynamic pipelines. Learners get to try out the data lineage feature as well to derive interesting insights into their data's history.

• Building Dynamic Pipelines in Cloud Data Fusion Using Macros
• In this lab you will learn how to use macros in Data Fusion that introduce dynamic variables to plugin configurations so that you can specify the variable substitutions at runtime.
• Creating Reusable Pipelines in Cloud Data Fusion
• In this lab you will learn how to build a reusable pipeline that reads data from Cloud Storage, performs data quality checks, and writes to Cloud Storage.
• Redacting Confidential Data within your Pipelines in Cloud Data Fusion
• In this lab you wil learn how to use the Cloud Data Fusion plugin for Cloud DLP to redact sensitive data.
• Exploring the Lineage of Data with Cloud Data Fusion
• This lab shows how to use Cloud Data Fusion to explore data lineage - the data's origins and its movement over time.