Accelerating Adoption of Data Lake for Streaming and Machine Learning Use Cases
Offered By: Databricks via YouTube
Course Description
Overview
Discover how Doordash and Databricks collaborated to accelerate the adoption of Databricks for machine learning and streaming use cases in this 28-minute conference talk. Learn about the tools and Databricks native features that can streamline the adoption process, including the Databricks Migration Diagnostics Tool, Delta Lake object builder, Apache Spark⢠SQL translator, Delta Lake validation and reconciliation tool, and Databricks Airflow dag migration tool. Gain insights into improving operational efficiency and enabling automation to ensure successful platform adoption. Explore the benefits of using Delta and Spark compute for optimized workload performance. Presented by Aydar Akhmetzyanov, Software Engineer at Doordash, and Harsha Reddy, Engineering Manager at Doordash, this talk offers valuable information for organizations on a similar journey of accelerating data lake adoption for streaming and machine learning applications.
Syllabus
Accelerating Adoption of Datalake for Streaming/ML Use Cases
Taught by
Databricks
Related Courses
CS115x: Advanced Apache Spark for Data Science and Data EngineeringUniversity of California, Berkeley via edX Big Data Analytics
University of Adelaide via edX Big Data Essentials: HDFS, MapReduce and Spark RDD
Yandex via Coursera Big Data Analysis: Hive, Spark SQL, DataFrames and GraphFrames
Yandex via Coursera Introduction to Apache Spark and AWS
University of London International Programmes via Coursera