Structural Engineering Courses

CodeWithYu

Building Robust Data Pipelines for Modern Data Engineering - End-to-End Project

Develop robust data pipelines using Apache Spark, Azure Databricks, and DBT. Master end-to-end data engineering with Azure, covering ingestion, integration, and transformation in a modern data architecture.

• YouTube
• 1 hour 59 minutes
• On-Demand
• Free Video

CodeWithYu

Realtime Voting System - End-to-End Data Engineering Project

Build a real-time voting system using Apache Kafka, Spark, and Streamlit. Learn end-to-end data engineering, from voter accreditation to live result dashboards and winner determination.

• YouTube
• 2 hours 19 minutes
• On-Demand
• Free Video

CodeWithYu

Realtime Streaming with Apache Flink - End-to-End Data Engineering Project

Build an end-to-end data engineering project using Apache Flink, Kafka, Elasticsearch, and Docker. Learn real-time data processing, create scalable pipelines, and develop streaming dashboards for sales analytics.

• YouTube
• 2 hours 26 minutes
• On-Demand
• Free Video

CodeWithYu

Realtime Change Data Capture Streaming - End-to-End Data Engineering Project

Implement real-time Change Data Capture streaming using Docker, Postgres, Debezium, Kafka, Apache Spark, and Slack. Create an efficient data pipeline for responsive data engineering projects.

• YouTube
• 1 hour 6 minutes
• On-Demand
• Free Video

CodeWithYu

Apache Flink for Sales Analytics - End-to-End Data Engineering Project

Develop an end-to-end sales analytics project using Apache Flink. Learn data ingestion, processing, complex transformations, and custom output formats for big data processing.

• YouTube
• 58 minutes
• On-Demand
• Free Video

CodeWithYu

Apache Spark Processing with AWS EMR - Data Engineering Project

Master AWS EMR for data processing: set up, submit Spark jobs, visualize on Hadoop UI, and leverage cloud computing for efficient big data handling.

• YouTube
• 39 minutes
• On-Demand
• Free Video

CodeWithYu

Realtime Socket Streaming with Apache Spark - End-to-End Data Engineering Project

Build a real-time data streaming pipeline using TCP/IP Socket, Apache Spark, OpenAI LLM, Kafka, and Elasticsearch. Process 7 million records for sentiment analysis and efficient data indexing.

• YouTube
• 1 hour 42 minutes
• On-Demand
• Free Video

CodeWithYu

Reddit Data Pipeline Engineering with AWS - End-to-End Data Engineering

Build a comprehensive Reddit data pipeline using AWS services, integrating Airflow, S3, Glue, Athena, and Redshift for efficient ETL processes and analytics.

• YouTube
• 1 hour 35 minutes
• On-Demand
• Free Video

CodeWithYu

End-to-End Data Engineering on Azure Spark Cluster: Japan Visa Analysis

Set up Spark master-worker architecture in Docker on Azure, process and visualize Japan visa data using PySpark and Plotly. Clean, transform, and gain insights into visa trends through interactive data analysis.

• YouTube
• 59 minutes
• On-Demand
• Free Video

CodeWithYu

Football Data Analytics with Tableau - Azure Data Engineering Project Part 3

Explore football data engineering: Extract Wikipedia data, store in Azure, migrate with Data Factory, query with Synapse, and visualize in Tableau. Master end-to-end data processes.

• YouTube
• 25 minutes
• On-Demand
• Free Video

CodeWithYu

Football Data Analytics: Azure End-to-End Data Engineering Project - Part 2

Extract, store, and analyze football data using Azure services and Apache Airflow. Develop end-to-end data engineering skills through hands-on implementation of a real-world project.

• YouTube
• 1 hour
• On-Demand
• Free Video

CodeWithYu

Football Data Analytics: Azure End-to-End Data Engineering Project

Extract, clean, and analyze football data using Apache Airflow, Azure services, and Tableau. Build a comprehensive data pipeline from Wikipedia to interactive visualizations.

• YouTube
• 1 hour 15 minutes
• On-Demand
• Free Video

CodeWithYu

Google Cloud Real-Time Streaming - End-to-End Data Engineering Project

Build an end-to-end data engineering pipeline for real-time YouTube Analytics, using Python, Google Cloud, Docker, and Kafka. Learn to fetch, process, and stream data, with instant Telegram notifications.

• YouTube
• 1 hour 28 minutes
• On-Demand
• Free Video

CodeWithYu

Realtime Data Streaming - End-to-End Data Engineering Project

Build a real-time data streaming pipeline using Apache Airflow, Kafka, Spark, and Cassandra. Learn end-to-end data engineering, from ingestion to processing and storage, all containerized with Docker.

• YouTube
• 1 hour 28 minutes
• On-Demand
• Free Video

CodeWithYu

End-to-End Data Engineering with Apache Airflow, Docker, and Spark Clusters - Using Python, Scala, and Java

Build an end-to-end data engineering project using Apache Airflow, Docker, Spark Clusters, Scala, Python, and Java. Create and submit jobs in multiple languages to a Spark cluster for processing and real-time results.

• YouTube
• 12 minutes
• On-Demand
• Free Video