Wrapping Up

Scrapy is a powerful program that includes a lot of built-in functionality. You can use the methods listed above to scrape multiple fields on a page. You can also use Scrapy to get information from multiple pages.

Every web scraper has its benefits and drawbacks. However, using a program like Scrapy will give you a good foundation moving forward even if you decide to use a different web scraper.

Visit Scrapy’s online documentation for more information on how to customize your data scrapers or if you have any questions regarding how to use Scrapy.