ETL in Azure Made Easy with Data Factory Mapping Data Flows

Discover how to simplify ETL processes in Azure using Data Factory Mapping Data Flows in this informative conference talk. Learn about the powerful combination of cloud orchestration and Spark clusters, creating a graphical, scalable data flow environment. Gain insights into Azure Data Factory's integration with Azure Databricks, enabling data transformation without writing Scala or Python code. Explore topics such as scaling strategies, Integration Runtimes, transformation options, and the step-by-step process of creating data flows and pipelines. Perfect for those new to Azure services, this talk provides an introduction to both Data Factory and Databricks before delving into the Mapping Data Flow feature.

Intro
Scaling Up vs Scaling Out
What is Data Factory
Integration Runtimes
Why Data Factory
Transformation Options
Mapping Data Flows
Waggle Data Flows
Data Transformation
Add Pipeline
Add Source
Aggregate