This comprehensive course is designed to hone your web scraping skills further, allowing you to implement scalable scripts that navigate through and extract data from multiple pages of a website. This course focuses on practical examples, like scraping quotes from 'http://quotes.toscrape.com', iteratively processing multiple pages and managing data extraction in a structured manner.
Overview
Syllabus
- Unit 1: Error Handling in Web Scraping
- Observing Error Handling in Web Scraping
- Complete Error Handling for Web Scraping
- Complete Web Scraping Script with Error Handling
- Unit 2: Advanced Link Navigation
- Running Quote Scraper with Author Navigation
- Complete the Quote Scraper with Author Details
- Add Author Description to Quote Scraper
- Scraping Books and Navigating to Product Pages
- Scraping Quotes and Author Details with Link Navigation
- Unit 3: Structured Data Extraction
- Running Web Scraper to Extract Quotes to CSV
- Update Author Data Extraction to Include Descriptions
- Complete the Web Scraping Function to Extract Quotes to CSV
- Enhancing Web Scraping to Extract Author Birthdates
- Web Scraping with Pagination and CSV Storage
- Unit 4: Web Scraping Best Practices
- Running a Web Scraper with Best Practices
- Fix Request Timeout Issue
- Adding Delays Between Requests
- Building a Complete Web Scraper with Best Practices