Mining Engineering Courses

CodeWithYu

Realtime Voting System - End-to-End Data Engineering Project

Build a real-time voting system using Apache Kafka, Spark, and Streamlit. Learn end-to-end data engineering, from voter accreditation to live result dashboards and winner determination.

• YouTube
• 2 hours 19 minutes
• Self-Paced
• Free Video

CodeWithYu

Realtime Streaming with Apache Flink - End-to-End Data Engineering Project

Build an end-to-end data engineering project using Apache Flink, Kafka, Elasticsearch, and Docker. Learn real-time data processing, create scalable pipelines, and develop streaming dashboards for sales analytics.

• YouTube
• 2 hours 26 minutes
• Self-Paced
• Free Video

CodeWithYu

Realtime Change Data Capture Streaming - End-to-End Data Engineering Project

Implement real-time Change Data Capture streaming using Docker, Postgres, Debezium, Kafka, Apache Spark, and Slack. Create an efficient data pipeline for responsive data engineering projects.

• YouTube
• 1 hour 6 minutes
• Self-Paced
• Free Video

CodeWithYu

Apache Flink for Sales Analytics - End-to-End Data Engineering Project

Develop an end-to-end sales analytics project using Apache Flink. Learn data ingestion, processing, complex transformations, and custom output formats for big data processing.

• YouTube
• 58 minutes
• Self-Paced
• Free Video

CodeWithYu

Apache Spark Processing with AWS EMR - Data Engineering Project

Master AWS EMR for data processing: set up, submit Spark jobs, visualize on Hadoop UI, and leverage cloud computing for efficient big data handling.

• YouTube
• 39 minutes
• Self-Paced
• Free Video

CodeWithYu

Reddit Data Pipeline Engineering with AWS - End-to-End Data Engineering

Build a comprehensive Reddit data pipeline using AWS services, integrating Airflow, S3, Glue, Athena, and Redshift for efficient ETL processes and analytics.

• YouTube
• 1 hour 35 minutes
• Self-Paced
• Free Video

CodeWithYu

End-to-End Data Engineering on Azure Spark Cluster: Japan Visa Analysis

Set up Spark master-worker architecture in Docker on Azure, process and visualize Japan visa data using PySpark and Plotly. Clean, transform, and gain insights into visa trends through interactive data analysis.

• YouTube
• 59 minutes
• Self-Paced
• Free Video

CodeWithYu

Football Data Analytics with Tableau - Azure Data Engineering Project Part 3

Explore football data engineering: Extract Wikipedia data, store in Azure, migrate with Data Factory, query with Synapse, and visualize in Tableau. Master end-to-end data processes.

• YouTube
• 25 minutes
• Self-Paced
• Free Video

CodeWithYu

Football Data Analytics: Azure End-to-End Data Engineering Project - Part 2

Extract, store, and analyze football data using Azure services and Apache Airflow. Develop end-to-end data engineering skills through hands-on implementation of a real-world project.

• YouTube
• 1 hour
• Self-Paced
• Free Video

CodeWithYu

Football Data Analytics: Azure End-to-End Data Engineering Project

Extract, clean, and analyze football data using Apache Airflow, Azure services, and Tableau. Build a comprehensive data pipeline from Wikipedia to interactive visualizations.

• YouTube
• 1 hour 15 minutes
• Self-Paced
• Free Video

CodeWithYu

Realtime Data Streaming - End-to-End Data Engineering Project

Build a real-time data streaming pipeline using Apache Airflow, Kafka, Spark, and Cassandra. Learn end-to-end data engineering, from ingestion to processing and storage, all containerized with Docker.

• YouTube
• 1 hour 28 minutes
• Self-Paced
• Free Video

CodeWithYu

End-to-End Data Engineering with Apache Airflow, Docker, and Spark Clusters - Using Python, Scala, and Java

Build an end-to-end data engineering project using Apache Airflow, Docker, Spark Clusters, Scala, Python, and Java. Create and submit jobs in multiple languages to a Spark cluster for processing and real-time results.

• YouTube
• 12 minutes
• Self-Paced
• Free Video

SQLBits

Data Engineering in Microsoft Fabric - Getting Started with Notebooks and Lakehouse

Explore data engineering in Microsoft Fabric: Notebooks, Lakehouse flexibility, Spark configurations, and Copilot-enhanced efficiency for developers.

• YouTube
• 44 minutes
• Self-Paced
• Free Video

SQLBits

Social Engineering - Hacking People

Learn to recognize and defend against social engineering attacks, enhancing your cybersecurity awareness and protecting yourself from manipulation.

• YouTube
• 51 minutes
• Self-Paced
• Free Video

SQLBits

Workflows of Highly Functional App and Data Engineering Teams

Master enterprise data engineering: schema management, standards enforcement, testing, and automated deployment for scalable, high-quality solutions.

• YouTube
• 50 minutes
• Self-Paced
• Free Video