Speed is Not All You Need for Data Processing
Offered By: PyCon US via YouTube
Course Description
Overview
Explore the evolving landscape of data processing frameworks in this PyCon US talk by Kevin Kho and Han Wang. Delve into a comparative analysis of popular tools like Pandas, Polars, DuckDB, and Spark, challenging common assumptions about their performance. Learn why speed alone may not be the determining factor when choosing a data processing framework. Discover surprising benchmarks that reveal Pandas UDFs can outperform native Spark in certain scenarios. Gain insights to help you select the most appropriate tools for your data processing needs, focusing on overall effectiveness rather than just raw speed.
Syllabus
Talks - Kevin Kho, Han Wang: Speed is Not All You Need for Data Processing
Taught by
PyCon US
Related Courses
Computational Investing, Part IGeorgia Institute of Technology via Coursera Введение в машинное обучение
Higher School of Economics via Coursera Математика и Python для анализа данных
Moscow Institute of Physics and Technology via Coursera Introduction to Python for Data Science
Microsoft via edX Python for Data Science
University of California, San Diego via edX