YoVDO

Speed is Not All You Need for Data Processing

Offered By: PyCon US via YouTube

Tags

Data Processing Courses Big Data Courses Python Courses Apache Spark Courses pandas Courses Benchmarking Courses DuckDB Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the evolving landscape of data processing frameworks in this PyCon US talk by Kevin Kho and Han Wang. Delve into a comparative analysis of popular tools like Pandas, Polars, DuckDB, and Spark, challenging common assumptions about their performance. Learn why speed alone may not be the determining factor when choosing a data processing framework. Discover surprising benchmarks that reveal Pandas UDFs can outperform native Spark in certain scenarios. Gain insights to help you select the most appropriate tools for your data processing needs, focusing on overall effectiveness rather than just raw speed.

Syllabus

Talks - Kevin Kho, Han Wang: Speed is Not All You Need for Data Processing


Taught by

PyCon US

Related Courses

CS115x: Advanced Apache Spark for Data Science and Data Engineering
University of California, Berkeley via edX Big Data Analytics
University of Adelaide via edX Big Data Essentials: HDFS, MapReduce and Spark RDD
Yandex via Coursera Big Data Analysis: Hive, Spark SQL, DataFrames and GraphFrames
Yandex via Coursera Introduction to Apache Spark and AWS
University of London International Programmes via Coursera