YoVDO

Processing Fast Data with Apache Spark - The Tale of Two Streaming APIs

Offered By: Devoxx via YouTube

Tags

Devoxx Courses Machine Learning Courses Apache Spark Courses Software Engineering Courses Data Engineering Courses Stream Processing Courses Spark Streaming Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the world of fast data processing with Apache Spark in this 50-minute conference talk from Devoxx. Dive into the two streaming APIs offered by Spark: the low-level Spark Streaming and the more declarative Structured Streaming. Learn about their capabilities, key differences, and practical applications in enterprise-level data analytics. Discover how to get started with both APIs, handle time and state management, implement functional coding strategies, and leverage machine learning capabilities. Through real-world examples, gain insights on choosing the right API or combining both to create functional and resilient streaming pipelines. Benefit from the expertise of Gerard Maas, a senior software engineer at Lightbend and co-author of "Stream Processing with Apache Spark," as he guides you through the intricacies of fast data architectures and their role in accelerating decision-making processes for businesses.

Syllabus

Introduction
Who am I
About Like Mint
Overview
What is Spark
What is Streaming
Structure Streaming
Duality
Structure Streaming API
Event Times
Visualization
Recap
Apache Spark Streaming
Second Notebook
Continuous Processing


Taught by

Devoxx

Related Courses

Advanced Big Data Systems | 高级大数据系统
Tsinghua University via edX
Data Streaming
Udacity
数据科学 | Data Science
Tsinghua University via edX
Apache Spark with Scala - Hands On with Big Data!
Udemy
Streaming Big Data with Spark Streaming and Scala
Udemy