YoVDO

Ingest data with Microsoft Fabric

Offered By: Microsoft via Microsoft Learn

Tags

Data Pipelines Courses Python Courses Apache Spark Courses Data Transformation Courses Data Ingestion Courses Microsoft Fabric Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
  • Module 1: Data ingestion is crucial in analytics. Microsoft Fabric's Data Factory offers Dataflows (Gen2) for visually creating multi-step data ingestion and transformation using Power Query Online.

    In this module, you'll learn how to:

    • Describe Dataflow (Gen2) capabilities in Microsoft Fabric
    • Create Dataflow (Gen2) solutions to ingest and transform data
    • Include a Dataflow (Gen2) in a pipeline
  • Module 2: Discover how to use Apache Spark and Python for data ingestion into a Microsoft Fabric lakehouse. Fabric notebooks provide a scalable and systematic solution.

    By the end of this module, you’ll be able to:

    • Ingest external data to Fabric lakehouses using Spark
    • Configure external source authentication and optimization
    • Load data into lakehouse as files or as Delta tables
  • Module 3: Use Data Factory pipelines in Microsoft Fabric

    In this module, you'll learn how to:

    • Describe pipeline capabilities in Microsoft Fabric
    • Use the Copy Data activity in a pipeline
    • Create pipelines based on predefined templates
    • Run and monitor pipelines

Syllabus

  • Module 1: Module 1: Ingest Data with Dataflows Gen2 in Microsoft Fabric
    • Introduction
    • Understand Dataflows (Gen2) in Microsoft Fabric
    • Explore Dataflows (Gen2) in Microsoft Fabric
    • Integrate Dataflows (Gen2) and Pipelines in Microsoft Fabric
    • Exercise - Create and use a Dataflow (Gen2) in Microsoft Fabric
    • Knowledge check
    • Summary
  • Module 2: Module 2: Ingest data with Spark and Microsoft Fabric notebooks
    • Introduction
    • Connect to data with Spark
    • Write data into a lakehouse
    • Consider uses for ingested data
    • Exercise - Ingest data with Spark and Microsoft Fabric notebooks
    • Knowledge check
    • Summary
  • Module 3: Module 3: Use Data Factory pipelines in Microsoft Fabric
    • Introduction
    • Understand pipelines
    • Use the Copy Data activity
    • Use pipeline templates
    • Run and monitor pipelines
    • Exercise - Ingest data with a pipeline
    • Knowledge check
    • Summary

Tags

Related Courses

CS115x: Advanced Apache Spark for Data Science and Data Engineering
University of California, Berkeley via edX Big Data Analytics
University of Adelaide via edX Big Data Essentials: HDFS, MapReduce and Spark RDD
Yandex via Coursera Big Data Analysis: Hive, Spark SQL, DataFrames and GraphFrames
Yandex via Coursera Introduction to Apache Spark and AWS
University of London International Programmes via Coursera