Pandas on Spark - Simplicity of Pandas with Efficiency of Spark
Offered By: Databricks via YouTube
Course Description
Overview
Explore a 30-minute talk by Databricks experts Matthew Powers and Xinrong Meng on Pandas API on Spark, a powerful solution that combines the simplicity of pandas with the scalability of Apache Spark. Learn how this tool addresses the limitations of traditional pandas by enabling distributed data processing for large datasets. Discover how to get started with Pandas on Spark and adapt existing pandas code to handle massive data volumes efficiently. Gain insights into leveraging SQL and machine learning capabilities for enhanced data analysis and processing. Perfect for data scientists and analysts looking to scale their Python-based data workflows without sacrificing the familiar pandas interface.
Syllabus
Pandas on Spark: Simplicity of Pandas with Efficiency of Spark
Taught by
Databricks
Related Courses
Web Intelligence and Big DataIndian Institute of Technology Delhi via Coursera Big Data for Better Performance
Open2Study Big Data and Education
Columbia University via edX Big Data Analytics in Healthcare
Georgia Institute of Technology via Udacity Data Mining with Weka
University of Waikato via Independent