Processing a Trillion Rows Per Day with Delta Lake at Adobe
Offered By: Databricks via YouTube
Course Description
Overview
Explore data patterns and practices adopted by Adobe for scaling across 8000+ self-managed Delta tables in this 21-minute conference talk. Dive into Adobe Experience Platform's approach to ingesting terabytes of data daily and managing petabytes of customer data for their Unified Profile offering. Learn about scaling writers, JVM agnostic locking, balancing multi-tenancy and single tenancy, transaction management, and using append-only DeltaTables for global history tracking. Discover anti-patterns, data manipulation using UDFs, and maintenance operation scaling challenges. Gain insights into powering various marketing scenarios across multiple platforms and channels, including email and advertisements.
Syllabus
Processing a Trillion Rows Per Day with Delta Lake at Adobe
Taught by
Databricks
Related Courses
Cisco SD-WAN (Viptela) with Lab AccessUdemy Architect SaaS Applications - Unique Challenges & Solutions
Udemy Provision IoT devices at scale by using Azure IoT Hub Device Provisioning Service (DPS)
Microsoft via Microsoft Learn Multi-Tenancy and Isolation Using Virtual Clusters in Kubernetes - Mirantis Labs Tech Talks
Mirantis via YouTube Secure Multi-Cluster & Multi-Tenant Cloud Native Apps with Mirantis & Tetrate
Mirantis via YouTube