ETL in Python

Leverage your Python and SQL knowledge to create an ETL pipeline to ingest, transform, and load data into a database.

Want to grow your data engineering skills and more efficiently process big data? Well, it’s time to develop your ETL skills. In this course, you’ll learn the foundations of creating pipelines to efficiently extract, transform, and load data into the systems your company commonly uses. You’ll get hands-on experience by helping a fictional private equity firm process the sales data they need to make informed business decisions when buying real estate. Jump in, learn how to create ETL pipelines, and develop one of the most in-demand engineering skills needed in the market.

Explore the data and requirements
-In this first chapter, you’ll be introduced to your role as a data engineer in a private equity fund. You'll be exposed to the whole ETL pipeline before deep-diving into its first phase: the extraction process.


Create the ETL foundations
-In this chapter you're going to create some important foundations for our ETL pipeline. In particular, along with data transformation, you'll start setting up the components needed to communicate with the database.


From raw to clean data
-This chapter is all about moving transformed data to a clean table, from which insights can be built. You'll explore how to create a unique key to perform insert and delete statements on SQLAlchemy. At the end of this chapter you'll complete the load process, the last step of the ETL pipeline.


From clean data to meaningful insights
-This chapter will show you how the data the ETL pipeline processes every month is used to build insights, readable by the fund’s shareholders.
You'll explore key SQL components to build more complex queries and create these insights. You'll also explore libraries that will translate raw SQL queries into more readable Excel files.