YoVDO

Ingest data with Microsoft Fabric

Offered By: Microsoft via Microsoft Learn

Tags

Data Pipelines Courses Python Courses Apache Spark Courses Data Transformation Courses Data Ingestion Courses Microsoft Fabric Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
  • Module 1: Data ingestion is crucial in analytics. Microsoft Fabric's Data Factory offers Dataflows (Gen2) for visually creating multi-step data ingestion and transformation using Power Query Online.

    In this module, you'll learn how to:

    • Describe Dataflow (Gen2) capabilities in Microsoft Fabric
    • Create Dataflow (Gen2) solutions to ingest and transform data
    • Include a Dataflow (Gen2) in a pipeline
  • Module 2: Discover how to use Apache Spark and Python for data ingestion into a Microsoft Fabric lakehouse. Fabric notebooks provide a scalable and systematic solution.

    By the end of this module, you’ll be able to:

    • Ingest external data to Fabric lakehouses using Spark
    • Configure external source authentication and optimization
    • Load data into lakehouse as files or as Delta tables
  • Module 3: Use Data Factory pipelines in Microsoft Fabric

    In this module, you'll learn how to:

    • Describe pipeline capabilities in Microsoft Fabric
    • Use the Copy Data activity in a pipeline
    • Create pipelines based on predefined templates
    • Run and monitor pipelines

Syllabus

  • Module 1: Module 1: Ingest Data with Dataflows Gen2 in Microsoft Fabric
    • Introduction
    • Understand Dataflows (Gen2) in Microsoft Fabric
    • Explore Dataflows (Gen2) in Microsoft Fabric
    • Integrate Dataflows (Gen2) and Pipelines in Microsoft Fabric
    • Exercise - Create and use a Dataflow (Gen2) in Microsoft Fabric
    • Knowledge check
    • Summary
  • Module 2: Module 2: Ingest data with Spark and Microsoft Fabric notebooks
    • Introduction
    • Connect to data with Spark
    • Write data into a lakehouse
    • Consider uses for ingested data
    • Exercise - Ingest data with Spark and Microsoft Fabric notebooks
    • Knowledge check
    • Summary
  • Module 3: Module 3: Use Data Factory pipelines in Microsoft Fabric
    • Introduction
    • Understand pipelines
    • Use the Copy Data activity
    • Use pipeline templates
    • Run and monitor pipelines
    • Exercise - Ingest data with a pipeline
    • Knowledge check
    • Summary

Tags

Related Courses

Deep Dive into Amazon Glacier
Amazon via Independent Preparing for your Professional Data Engineer Journey
Google Cloud via Coursera Building Resilient Streaming Systems on Google Cloud Platform en Français
Google Cloud via Coursera IBM AI Enterprise Workflow
IBM via Coursera Introduction to Designing Data Lakes on AWS
Amazon Web Services via edX