Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Boot.dev

Build a Web Scraper in Go

via Boot.dev

Overview

Stuck in Tutorial Hell? Learn Backend Dev the Right Way
Boot.dev teaches Python, SQL & Go through projects you won't want to stop. 25% off with code CLASSCENTRAL.
Get 25% Off
Build a web scraper in Go that crawls sites and reports internal links. Practice HTTP, HTML parsing, and real crawler logic.

Syllabus

  • Setup
    • Setup the environment.
  • Crawling
    • Build the core crawling engine by implementing the main crawler logic, HTTP request handling, and recursive page discovery to systematically traverse websites.
  • Concurrency
    • Learn to speed up your web crawler using goroutines and concurrency, crawling multiple pages simultaneously while respecting configurable limits.
  • Reporting
    • Learn to analyze and export your web scraping results with custom reporting tools that generate both human-readable summaries and JSON datasets for further analysis.

Reviews

4.7 rating at Boot.dev based on 61 ratings

Start your review of Build a Web Scraper in Go

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.