DP-700T00 – Implement Data Engineering Solutions with Microsoft Fabric

Course Duration

4 Days

Audience

Employees of federal, state and local governments; and businesses working with the government.

Prerequisites

Experience in data extraction, transformation, and loading. Familiarity with SQL, PySpark, or Kusto Query Language (KQL). Basic understanding of data integration and orchestration.

Course Description

This course covers methods and practices to implement data engineering solutions using Microsoft Fabric. Students learn how to design and develop effective data loading patterns, data architectures, and orchestration processes. Topics include ingesting and transforming data and securing, managing, and monitoring data engineering solutions. This course is designed for data professionals with some data integration and orchestration experience.

Learning Objectives

• Design and implement data loading patterns and architectures in Microsoft Fabric
• Ingest and transform data using Dataflows Gen2 and pipelines
• Work with lakehouses, Delta Lake tables, and data warehouses in Fabric
• Use Apache Spark and KQL for data processing and real-time analytics
• Implement medallion architecture for lakehouse organization
• Secure and monitor Microsoft Fabric data engineering solutions
• Implement CI/CD and version control in a Fabric environment
• Administer a Microsoft Fabric environment including permissions and governance

Course Outline

Module 1 – Ingest Data with Dataflows Gen2

• Understand Dataflows Gen2 in Microsoft Fabric
• Explore and configure Dataflows Gen2
• Integrate Dataflows Gen2 and Pipelines

Module 2 – Orchestrate Processes and Data Movement

• Understand pipelines in Microsoft Fabric
• Use the Copy Data activity
• Use pipeline templates
• Run and monitor pipelines

Module 3 – Use Apache Spark in Microsoft Fabric

• Prepare to use Apache Spark
• Run Spark code and work with Spark dataframes
• Work with data using Spark SQL
• Visualize data in a Spark notebook

Module 4 – Work with Lakehouses

• Explore the Microsoft Fabric lakehouse
• Work with and transform data in a lakehouse
• Organize a lakehouse using medallion architecture

Module 5 – Work with Delta Lake Tables

• Understand Delta Lake
• Create and optimize delta tables
• Work with delta tables in Spark and with streaming data

Module 6 – Real-Time Intelligence and Eventstream

• Get started with Real-Time Intelligence in Microsoft Fabric
• Work with real-time data in an Eventhouse
• Use KQL effectively — materialized views and stored functions
• Use Eventstream sources, destinations, and transformations
• Create Real-Time Dashboards

Module 7 – Data Warehouses in Microsoft Fabric

• Understand data warehouse fundamentals in Fabric
• Load data using pipelines, T-SQL, and Dataflow Gen2
• Query and transform data in a warehouse
• Monitor and secure a Microsoft Fabric data warehouse

Module 8 – CI/CD, Monitoring, and Administration

• Implement version control and Git integration
• Implement deployment pipelines and automate CI/CD
• Monitor activities with Fabric Monitor Hub and Activator
• Secure data access — workspace permissions and granular controls
• Administer a Microsoft Fabric environment

Frequently Asked Questions