Building a Unified Feature Platform with DuckDB and Arrow
Offered By: Data Council via YouTube
Course Description
Overview
Dive into a technical talk by Mike Eastham, Chief Architect at Tecton, exploring the development of Tecton's innovative Feature Platform for Machine Learning. Learn how DuckDB and Arrow are leveraged to address data transformation challenges and provide a faster, more integrated local development experience. Discover effective strategies for scaling datasets without a distributed query engine, techniques for implementing DuckDB extensions, and insights on creating interoperability with DeltaLake outside the Spark ecosystem. Compare performance with Spark and understand how Tecton utilizes cloud resources to handle large datasets while maintaining an optimal laptop developer experience. Gain valuable knowledge on building cutting-edge data and AI systems from this 36-minute session presented at Data Council.
Syllabus
Building a Unified Feature Platform with DuckDB and Arrow
Taught by
Data Council
Related Courses
CS115x: Advanced Apache Spark for Data Science and Data EngineeringUniversity of California, Berkeley via edX Big Data Analytics
University of Adelaide via edX Big Data Essentials: HDFS, MapReduce and Spark RDD
Yandex via Coursera Big Data Analysis: Hive, Spark SQL, DataFrames and GraphFrames
Yandex via Coursera Introduction to Apache Spark and AWS
University of London International Programmes via Coursera