Create and Monitor Data Pipelines for a Stream Processing Solution
Offered By: Pluralsight
Course Description
Overview
This course will teach you how to create, configure, monitor, and troubleshoot Azure Stream Analytics jobs to process live streaming data.
Azure gives you all of the resources you need to create and monitor data pipelines and find the data processing solutions you need. In this course, Create and Monitor Data Pipelines for a Stream Processing Solution, you'll learn how to work with stream processing pipelines in Azure in order to create, configure, monitor, and troubleshoot Azure Stream Analytics jobs. First, you'll discover the components of a stream analytics job and why each of them are important. Next, you'll explore how to handle the data coming from the pipeline (insert and update), how to visualize the data in different time windows, and how to troubleshoot such a job. Finally, you'll learn how to improve the performance of your job, by choosing the number of streaming units, parallelizing the query, and using repartitioning to scale your query. By the end of this course, you'll have a better understanding of what it means to create and monitor real-time data processing solutions in Azure.
Azure gives you all of the resources you need to create and monitor data pipelines and find the data processing solutions you need. In this course, Create and Monitor Data Pipelines for a Stream Processing Solution, you'll learn how to work with stream processing pipelines in Azure in order to create, configure, monitor, and troubleshoot Azure Stream Analytics jobs. First, you'll discover the components of a stream analytics job and why each of them are important. Next, you'll explore how to handle the data coming from the pipeline (insert and update), how to visualize the data in different time windows, and how to troubleshoot such a job. Finally, you'll learn how to improve the performance of your job, by choosing the number of streaming units, parallelizing the query, and using repartitioning to scale your query. By the end of this course, you'll have a better understanding of what it means to create and monitor real-time data processing solutions in Azure.
Syllabus
- Course Overview 2mins
- Creating a Stream Processing Solution with Azure Technology 42mins
- Optimizing Your Stream Analytics Job 21mins
Taught by
Ana Voicu
Related Courses
Azure Data Lake Storage Gen2 and Data Streaming SolutionMicrosoft via Coursera Microsoft Future Ready: Azure Cloud Fundamentals
Cloudswyft via FutureLearn Microsoft Future Ready: Introduction to Azure Cloud for Data Scientists
Cloudswyft via FutureLearn Delivering a Data Warehouse in the Cloud
Microsoft via edX Microsoft Azure Synapse for Developers
LinkedIn Learning