YoVDO

Data Engineering Foundations

Offered By: LinkedIn Learning

Tags

Databases Courses Hadoop Courses Apache Spark Courses Apache Airflow Courses PostgreSQL Courses Data Extraction Courses MapReduce Courses Data Engineering Courses ETL Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Learn the key facets of data engineering, from its place in the data science realm, to the specific tasks and skills every data engineer should possess.

Syllabus

Introduction
  • What is data engineering?
1. Introduction to Data Engineering
  • Introduction to data engineering
  • Data engineer vs. data scientist
  • Essential tools for data engineering
2. Databases and Dataframes
  • Intro to databases and their types
  • Understanding database schema
  • Distributive computing
3. Data Engineering Tools
  • MapReduce and Hadoop
  • Hive
  • Spark
  • Airflow
4. ETL Pipelines
  • Sources of data extraction
  • Data extraction from a PostgreSQL database
  • Challenge: Data extraction
  • Solution: Data extraction
  • Transforming data
  • Challenge: Transforming data
  • Solution: Transforming data
  • Loading data into a DB
  • Challenge: Loading data
  • Solution: Loading data
  • Scheduling ETL pipeline using Airflow
Conclusion
  • Next steps

Taught by

Harshit Tyagi

Related Courses

Web Application Development: The Data Tier
University of New Mexico via Coursera Desarrollo de Aplicaciones Web: Nivel de Datos
University of New Mexico via Coursera Hacking PostgreSQL: Data Access Methods
Ural Federal University via edX Spatial Data Science and Applications
Yonsei University via Coursera RDBMS PostgreSQL
Indian Institute of Technology Bombay via Swayam