Apache Spark Processing with AWS EMR - Data Engineering Project
Offered By: CodeWithYu via YouTube
Course Description
Overview
Dive into the world of AWS and master Amazon Elastic Map Reduce (EMR) in this 39-minute data engineering tutorial. Learn to set up EMR and Cloud9 on AWS, create Spark jobs with S3, submit tasks to EMR, visualize processes on EMR Spark and Hadoop UI, and use EMR Steps for cluster submission. Gain practical insights into cloud computing, big data processing, and data visualization techniques essential for data engineers. Follow along with timestamps, access provided resources, and enhance your skills in AWS, Spark, and data processing for cloud environments.
Syllabus
- Introduction
- Setting up EMR on AWS
- Setting up Cloud9 on AWS
- Setting Up a Spark Job with S3
- Submitting Jobs to EMR
- Visualizing the Process on EMR Spark and Hadoop UI
- Submitting to the Cluster with EMR Steps
- Results
Taught by
CodeWithYu
Related Courses
Communicating Data Science ResultsUniversity of Washington via Coursera Cloud Computing Applications, Part 2: Big Data and Applications in the Cloud
University of Illinois at Urbana-Champaign via Coursera Cloud Computing Infrastructure
University System of Maryland via edX Google Cloud Platform for AWS Professionals
Google via Coursera Introduction to Apache Spark and AWS
University of London International Programmes via Coursera