So far, we have learned how to use a number of data finding techniques and how to access web content by implementing various Python libraries for web scraping.
Selenium is a web application testing framework, which automates the browsing action and can be used for both easy and complex web scraping activities. Selenium provides a web browser as an interface or automated tool. Dynamic or secure web content that uses JavaScript, cookies, scripts, and so on are loaded, tested, and even scraped with the help of Selenium.
There is so much to learn about the Selenium framework. In this chapter, we will be covering the major concepts of the framework that are relevant to web scraping.
This chapter will cover the following topics:
- Introduction to Selenium
- Using Selenium for web scraping