Apache Spark Processing with AWS EMR - Data Engineering Project
Offered By: CodeWithYu via YouTube
Course Description
Overview
Dive into the world of AWS and master Amazon Elastic Map Reduce (EMR) in this 39-minute data engineering tutorial. Learn to set up EMR and Cloud9 on AWS, create Spark jobs with S3, submit tasks to EMR, visualize processes on EMR Spark and Hadoop UI, and use EMR Steps for cluster submission. Gain practical insights into cloud computing, big data processing, and data visualization techniques essential for data engineers. Follow along with timestamps, access provided resources, and enhance your skills in AWS, Spark, and data processing for cloud environments.
Syllabus
- Introduction
- Setting up EMR on AWS
- Setting up Cloud9 on AWS
- Setting Up a Spark Job with S3
- Submitting Jobs to EMR
- Visualizing the Process on EMR Spark and Hadoop UI
- Submitting to the Cluster with EMR Steps
- Results
Taught by
CodeWithYu
Related Courses
内存数据库管理openHPI CS115x: Advanced Apache Spark for Data Science and Data Engineering
University of California, Berkeley via edX Processing Big Data with Azure Data Lake Analytics
Microsoft via edX Google Cloud Big Data and Machine Learning Fundamentals en Español
Google Cloud via Coursera Google Cloud Big Data and Machine Learning Fundamentals 日本語版
Google Cloud via Coursera