Processing a Trillion Rows Per Day with Delta Lake at Adobe
Offered By: Databricks via YouTube
Course Description
Overview
Explore data patterns and practices adopted by Adobe for scaling across 8000+ self-managed Delta tables in this 21-minute conference talk. Dive into Adobe Experience Platform's approach to ingesting terabytes of data daily and managing petabytes of customer data for their Unified Profile offering. Learn about scaling writers, JVM agnostic locking, balancing multi-tenancy and single tenancy, transaction management, and using append-only DeltaTables for global history tracking. Discover anti-patterns, data manipulation using UDFs, and maintenance operation scaling challenges. Gain insights into powering various marketing scenarios across multiple platforms and channels, including email and advertisements.
Syllabus
Processing a Trillion Rows Per Day with Delta Lake at Adobe
Taught by
Databricks
Related Courses
Data Processing with AzureLearnQuest via Coursera Mejores prácticas para el procesamiento de datos en Big Data
Coursera Project Network via Coursera Data Science with Databricks for Data Analysts
Databricks via Coursera Azure Data Engineer con Databricks y Azure Data Factory
Coursera Project Network via Coursera Curso Completo de Spark con Databricks (Big Data)
Coursera Project Network via Coursera