CodeWithYu Courses

End-to-End Modern Data Engineering with DBT and BigQuery

1 rating

Master modern data engineering with DBT and BigQuery. Set up, link, transform data, convert tables to views, seed data, write tests, and generate documentation in this comprehensive tutorial.

• YouTube
• 30 minutes
• Self-Paced
• Free Video

Apache Spark on Kubernetes - The RIGHT Way - No Master/Worker Clusters Needed

Master running Apache Spark on Kubernetes without permanent clusters - deploy jobs that auto-scale, self-cleanup, and eliminate costly always-on infrastructure.

• YouTube
• 58 minutes
• Self-Paced
• Free Video

Building Distributed Modern Data Lakehouse From Scratch with Apache Iceberg - An End to End Project

Master building a distributed data lakehouse from scratch using Apache Iceberg, Trino, Airflow, DBT, MinIO, and Nessie in this comprehensive hands-on project.

• YouTube
• 1 hour 58 minutes
• Self-Paced
• Free Video

Apache Iceberg Explained in 10 Minutes - Everything You Need to Know

Discover Apache Iceberg's powerful open table format for big data analytics, exploring its key features, benefits, and differences from Delta Lake and Hudi in just 10 minutes.

• YouTube
• 12 minutes
• Self-Paced
• Free Video

Building Agentic Self-Healing Data Pipeline - End to End Data Engineering Project

Master building AI-powered data pipelines with Apache Airflow 3.0 and Ollama that automatically detect, diagnose, and heal data quality issues in real-time without manual intervention.

• YouTube
• 1 hour 34 minutes
• Self-Paced
• Free Video

Build Churn Training and Inference AI from Scratch - End to End Machine Learning Project - Part 1

Master building a complete churn prediction system using Apache Airflow, MLFlow, and Streamlit with industry best practices for ML model development and deployment.

• YouTube
• 51 minutes
• Self-Paced
• Free Video

Building Realtime End-to-End Sales Forecasting ML Pipeline

Master production-grade sales forecasting ML pipelines using Astro and Apache Airflow, from data ingestion to real-time inference with Streamlit UI deployment.

• YouTube
• 5 hours
• Self-Paced
• Free Video

Realtime Stock Market Anomaly Detection Using Machine Learning - End-to-End Data Engineering Project

Develop an end-to-end data engineering project for real-time stock market anomaly detection using Quix Streams, Redpanda, and Docker. Learn to build a complete data pipeline and deploy an advanced ML model.

• YouTube
• 1 hour 2 minutes
• Self-Paced
• Free Video

Building Realtime Data Warehouses from Scratch - End-to-End Data Engineering Project

Design and implement a real-time data warehouse with Apache Airflow, Kafka, and Pinot. Create custom hooks, ingest batch and streaming data, and visualize evolving data using Apache Superset.

• YouTube
• 2 hours 9 minutes
• Self-Paced
• Free Video

Query Optimization for Data Engineers - End-to-End Walkthrough

Optimize SQL queries for data engineering projects using dbForge Studio. Learn database restoration, data generation, profiling, analysis, and design techniques in this comprehensive walkthrough.

• YouTube
• 52 minutes
• Self-Paced
• Free Video

Realtime Algorithmic Trading with Apache Flink - End-to-End Data Engineering Project

Develop an end-to-end algorithmic trading system using Apache Flink, Kafka, and Python. Learn real-time data processing, custom algorithms, and financial market insights.

• YouTube
• 1 hour 42 minutes
• Self-Paced
• Free Video

Realtime Streaming with Data Lakehouse - End-to-End Data Engineering Project

Design, implement, and maintain secure, scalable lakehouse architectures using Apache Spark, Kafka, Flink, Delta Lake, AWS, and open-source tools. Unlock data's potential through advanced analytics and machine learning.

• YouTube
• 1 hour 10 minutes
• Self-Paced
• Free Video

Building Data Lakehouse from Scratch - End-to-End Data Engineering Project

Design, implement, and maintain scalable lakehouse architectures using Apache Spark, Kafka, Flink, Delta Lake, AWS, and open-source tools. Enhance data potential through advanced analytics and machine learning.

• YouTube
• 55 minutes
• Self-Paced
• Free Video

Real Estate End-to-End Data Engineering Using AI

Build a real estate data engineering pipeline using AI, WebSocket, Docker, Kafka, Spark, and Cassandra. Learn to gather, process, and store property data in real-time with advanced tools and techniques.

• YouTube
• 2 hours 8 minutes
• Self-Paced
• Free Video

Designing Data Warehouse from Scratch - End-to-End Data Engineering

Master end-to-end data warehouse design, from logical architecture to physical implementation. Learn AWS Redshift, data loading, and medallion architecture for efficient data engineering.

• YouTube
• 2 hours 41 minutes
• Self-Paced
• Free Video