Explore an in-depth tutorial on football data engineering, covering the entire process from data extraction to visualization. Learn how to extract football data from Wikipedia using Apache Airflow, store it in Azure Data Lake, migrate data with Azure Data Factory, query with Azure Synapse, and visualize findings in Tableau. Follow step-by-step instructions on creating a free Azure account, setting up storage accounts, pushing data from Airflow to Azure Data Lake, configuring Data Factory for integration, and writing complex queries with Synapse. Gain practical insights into leveraging various Azure services and tools for effective data engineering in the context of football analytics.

Syllabus

- Introduction
- Creating a free Azure account
- Setting up storage account
- Pushing Data from Airflow to Azure Data Lake
- Setting up Data Factory
- Data Integration with Data Factory
- Setting up Synapse Analytics
- Writing Complex Queries with Synapse
- Outro