YoVDO

What's Next for the Upcoming Apache Spark 4.0

Offered By: Databricks via YouTube

Tags

Apache Spark Courses SQL Courses XML Courses Databricks Courses PySpark Courses Data Processing Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Discover the significant enhancements coming in Apache Spark 4.0 through this informative 38-minute presentation by Databricks engineers. Learn about Spark Connect's GA for improved usability and debuggability, Structured Logging for enhanced error analysis, and major PySpark updates including python data source APIs and arrow-optimized UDFs. Explore expanded SQL capabilities, new native XML and Databricks connectors, and improvements in real-time data processing with the Arbitrary State API v2. Gain insights on how to leverage these advancements for optimized data processing and analytics in your projects. The talk, presented by Wenchen Fan and Xiao Li from Databricks, offers valuable information for developers and data professionals looking to stay ahead with the latest Apache Spark developments.

Syllabus

What’s Next for the Upcoming Apache Spark 4.0?


Taught by

Databricks

Related Courses

CS115x: Advanced Apache Spark for Data Science and Data Engineering
University of California, Berkeley via edX Big Data Analytics
University of Adelaide via edX Big Data Essentials: HDFS, MapReduce and Spark RDD
Yandex via Coursera Big Data Analysis: Hive, Spark SQL, DataFrames and GraphFrames
Yandex via Coursera Introduction to Apache Spark and AWS
University of London International Programmes via Coursera