Scraping Dynamic Web Pages with Python 3 and Selenium

Go from saying hello to Selenium to combining it with Python and Beautiful Soup to extract information from a dynamic web page. Master WebDriver navigation, user activity recording, and more while creating a real estate web scraper in this course.

There are many ways to collect data, one of which is extracting the tons of data swimming around in the form of websites. However, gathering and analyzing data from dynamic websites can be frustrating, especially when essential information is only available after interacting with web elements. In this course, Scraping Dynamic Web Pages with Python 3 and Selenium, you'll gain the ability to efficiently extract data from dynamically-rendered web pages. First, you'll explore how to understand and navigate dynamic web pages using Selenium WebDriver, as well as how to record, replay, and customize user activity sessions to interact with web elements effectively. Next, you'll discover how to manage wait times, locate elements, and navigate complex web pages with various types of selectors. Then, you'll dive into parsing HTML using Beautiful Soup and applying best practices for web scraping. Finally, you'll learn how to implement a real estate property scraper project, putting all the acquired skills into practice. When you're finished with this course, you'll have the skills and knowledge of web scraping with Python and Selenium needed to efficiently extract valuable data from dynamically-rendered web pages.

• Course Overview 2mins
• Mastering Dynamic Web Navigation 26mins
• Automating and Customizing User Interactions 22mins
• Locating, Navigating, and Engaging Web Elements 25mins
• Unleashing the Power of HTML Parsing and Scraping 25mins