We have used and explored various libraries and techniques for web scraping so far in this book. The latest libraries available adapt to new concepts and implement the techniques in a more effective, diverse, and easy way; Scrapy is among one of those libraries.
We will be introducing and using Scrapy (an open source web crawling framework written in Python) in this section. For more detailed information on Scrapy, please visit the official documentation at http://docs.scrapy.org/en/latest/.
In this section, we will be implementing scraping features and building a project demonstrating useful concepts.