CodeWithYu Courses

Designing Data Warehouse from Scratch - End-to-End Data Engineering

Master end-to-end data warehouse design, from logical architecture to physical implementation. Learn AWS Redshift, data loading, and medallion architecture for efficient data engineering.

• YouTube
• 2 hours 41 minutes
• Self-Paced
• Free Video

Smart City End-to-End Realtime Data Engineering Project - AWS Data Engineer

Build a smart city real-time data pipeline using AWS, Apache tools, and Docker. Learn end-to-end data engineering from ingestion to visualization with PowerBI, covering IoT, streaming, and cloud technologies.

• YouTube
• 2 hours 27 minutes
• Self-Paced
• Free Video

Kubernetes for Modern Data Engineering: An End-to-End Data Engineering Project

Master Kubernetes for data engineering: set up, deploy dashboard, run Apache Airflow with Helm charts. Learn kubectl, manage clusters, and optimize workflows for scalable data processing.

• YouTube
• 1 hour 25 minutes
• Self-Paced
• Free Video

CI/CD for Modern Data Engineering - End-to-End Project on Azure with Terraform

Implement CI/CD for modern data engineering using Azure and Terraform. Automate infrastructure, storage, and data factory deployment with hands-on guidance and practical examples.

• YouTube
• 1 hour 10 minutes
• Self-Paced
• Free Video

Building Robust Data Pipelines for Modern Data Engineering - End-to-End Project

Develop robust data pipelines using Apache Spark, Azure Databricks, and DBT. Master end-to-end data engineering with Azure, covering ingestion, integration, and transformation in a modern data architecture.

• YouTube
• 1 hour 59 minutes
• Self-Paced
• Free Video

Realtime Voting System - End-to-End Data Engineering Project

Build a real-time voting system using Apache Kafka, Spark, and Streamlit. Learn end-to-end data engineering, from voter accreditation to live result dashboards and winner determination.

• YouTube
• 2 hours 19 minutes
• Self-Paced
• Free Video

Realtime Streaming with Apache Flink - End-to-End Data Engineering Project

Build an end-to-end data engineering project using Apache Flink, Kafka, Elasticsearch, and Docker. Learn real-time data processing, create scalable pipelines, and develop streaming dashboards for sales analytics.

• YouTube
• 2 hours 26 minutes
• Self-Paced
• Free Video

Realtime Change Data Capture Streaming - End-to-End Data Engineering Project

Implement real-time Change Data Capture streaming using Docker, Postgres, Debezium, Kafka, Apache Spark, and Slack. Create an efficient data pipeline for responsive data engineering projects.

• YouTube
• 1 hour 6 minutes
• Self-Paced
• Free Video

Apache Flink for Sales Analytics - End-to-End Data Engineering Project

Develop an end-to-end sales analytics project using Apache Flink. Learn data ingestion, processing, complex transformations, and custom output formats for big data processing.

• YouTube
• 58 minutes
• Self-Paced
• Free Video

Apache Spark Processing with AWS EMR - Data Engineering Project

Master AWS EMR for data processing: set up, submit Spark jobs, visualize on Hadoop UI, and leverage cloud computing for efficient big data handling.

• YouTube
• 39 minutes
• Self-Paced
• Free Video

Creating and Submitting Java Spark Jobs to Spark Clusters

Create and submit Java Spark jobs to clusters. Learn end-to-end data engineering with Airflow, Docker, Spark, Scala, Python, and Java. Build and process jobs in multiple languages for live results.

• YouTube
• 25 minutes
• Self-Paced
• Free Video

Apache Airflow with Spark for Data Engineers - Full Course

Build end-to-end data engineering projects using Apache Airflow, Docker, Spark, and multiple programming languages. Learn to create and submit jobs to Spark clusters for processing and view real-time results.

• YouTube
• 1 hour 9 minutes
• Self-Paced
• Free Video

Realtime Socket Streaming with Apache Spark - End-to-End Data Engineering Project

Build a real-time data streaming pipeline using TCP/IP Socket, Apache Spark, OpenAI LLM, Kafka, and Elasticsearch. Process 7 million records for sentiment analysis and efficient data indexing.

• YouTube
• 1 hour 42 minutes
• Self-Paced
• Free Video

Reddit Data Pipeline Engineering with AWS - End-to-End Data Engineering

Build a comprehensive Reddit data pipeline using AWS services, integrating Airflow, S3, Glue, Athena, and Redshift for efficient ETL processes and analytics.

• YouTube
• 1 hour 35 minutes
• Self-Paced
• Free Video

End-to-End Data Engineering on Azure Spark Cluster: Japan Visa Analysis

Set up Spark master-worker architecture in Docker on Azure, process and visualize Japan visa data using PySpark and Plotly. Clean, transform, and gain insights into visa trends through interactive data analysis.

• YouTube
• 59 minutes
• Self-Paced
• Free Video