YoVDO

Monitoring and Optimizing Queries in Databricks SQL

Offered By: Pluralsight

Tags

Databricks Courses Data Analysis Courses SQL Courses Data Engineering Courses

Course Description

Overview

This course will teach you to monitor query executions in Databricks SQL, and also regulate access to query objects. You will learn how to optimize query executions with caches, encrypt queries, and configure alerts based on query results.

Queries lie at the heart of Databricks SQL and managing them correctly will ensure that we make the best use of this platform. In this course, Monitoring and Optimizing Queries in Databricks SQL, you will learn various aspects of query management, from basic administration to encryption, with a special emphasis on query monitoring and optimization. First, you will explore how to create a Delta table and queries which run against it. Next, you will discover how query execution times can be reduced by two different caching mechanisms supported by Databricks SQL - Delta caching and Spark caching. Finally, you will learn how we can monitor the results of query executions and trigger an alert when those results fulfill a specific condition. At the end of this course, you will be well-versed with various aspects of query management, which will help you ensure that your queries are configured correctly, that they run in an optimal manner, and that you are alerted the moment their results point to something that is off.

Syllabus

  • Course Overview 2mins
  • Monitoring and Administering Queries 43mins
  • Optimizing Query Executions 39mins
  • Creating and Configuring Query Alerts 28mins

Taught by

Kishan Iyer

Related Courses

Azure Data Engineer con Databricks y Azure Data Factory
Coursera Project Network via Coursera
Curso Completo de Spark con Databricks (Big Data)
Coursera Project Network via Coursera
Data Processing with Azure
LearnQuest via Coursera
Data Science with Databricks for Data Analysts
Databricks via Coursera
Apache Spark Deep Learning Essential Training
LinkedIn Learning