CodeWithYu Courses

End-to-End Modern Data Engineering with DBT and BigQuery

1 rating

Master modern data engineering with DBT and BigQuery. Set up, link, transform data, convert tables to views, seed data, write tests, and generate documentation in this comprehensive tutorial.

• YouTube
• 30 minutes
• Self-Paced
• Free Video

Realtime Streaming for Anomaly Detection - An End-to-End Data Engineering Project

Build a real-time anomaly detection system using streaming data engineering techniques. Learn end-to-end implementation for monitoring and identifying unusual patterns in data streams.

• YouTube
• 1 hour 6 minutes
• Self-Paced
• Free Video

Real-time Logs Processing with Apache Airflow, Kafka and Elasticsearch - Part 1

Master real-time log processing by building a scalable system using Apache Airflow, Kafka, and Elasticsearch. Learn system architecture, website log production, and cluster setup for handling billions of records.

• YouTube
• 1 hour 25 minutes
• Self-Paced
• Free Video

Monitoring High-Performance Systems with Real-Time Data Engineering - Part 1

Discover how to architect and monitor high-throughput data pipelines using Kafka, Spark, ELK Stack, and Prometheus for processing billions of records efficiently in real-time.

• YouTube
• 28 minutes
• Self-Paced
• Free Video

Building Realtime End-to-End Sales Forecasting ML Pipeline

Master production-grade sales forecasting ML pipelines using Astro and Apache Airflow, from data ingestion to real-time inference with Streamlit UI deployment.

• YouTube
• 5 hours
• Self-Paced
• Free Video

Building Distributed Modern Data Lakehouse From Scratch with Apache Iceberg - An End to End Project

Master building a distributed data lakehouse from scratch using Apache Iceberg, Trino, Airflow, DBT, MinIO, and Nessie in this comprehensive hands-on project.

• YouTube
• 1 hour 58 minutes
• Self-Paced
• Free Video

Apache Iceberg Explained in 10 Minutes - Everything You Need to Know

Discover Apache Iceberg's powerful open table format for big data analytics, exploring its key features, benefits, and differences from Delta Lake and Hudi in just 10 minutes.

• YouTube
• 12 minutes
• Self-Paced
• Free Video

End-to-End Monitoring with Prometheus, Grafana, Apache Kafka and Spark for Data Engineering

Master real-time monitoring setup for high-performance data pipelines using Prometheus, Grafana, Kafka, and Spark to process and track 1.2 billion records hourly through hands-on configuration and dashboard creation.

• YouTube
• 20 minutes
• Self-Paced
• Free Video

Build a Fraud Detection AI from Scratch - End to End Machine Learning Project - Part 1

Master the end-to-end process of building a scalable, real-time fraud detection system using Apache Kafka, Spark, and modern ML workflows, from architecture design to model deployment and performance optimization.

• YouTube
• 4 hours 51 minutes
• Self-Paced
• Free Video

DevOps in Data Engineering: End-to-End Automation with CI/CD, Terraform and AWS - Part 1

Dive into end-to-end DevOps for data engineering with CI/CD pipelines, automated testing, and infrastructure as code using Terraform, GitHub Actions, and AWS to streamline your data workflows.

• YouTube
• 57 minutes
• Self-Paced
• Free Video

10-Step Roadmap to Become an Expert Data Engineer with Projects

Master a complete 10-step roadmap from beginner to expert data engineer with hands-on cloud projects across Azure, AWS, and GCP, covering essential tools, pipelines, architecture, and job preparation strategies.

• YouTube
• 37 minutes
• Self-Paced
• Free Video

High-Performance Data Engineering with Kafka and Spark - Processing 1.2 Billion Records Per Hour

Master high-performance data engineering by building a system processing 1.2B records/hour using Kafka, Spark, ELK Stack, and monitoring tools. Includes architecture design, implementation, and optimization strategies.

• YouTube
• 2 hours 18 minutes
• Self-Paced
• Free Video

Monitoring High-Performance Data Pipelines with Elasticsearch - Part 1

Master high-throughput data pipeline monitoring using Elasticsearch, Filebeat, and Logstash. Set up real-time tracking for systems processing 1.2B records/hour while implementing effective log management and querying capabilities.

• YouTube
• 35 minutes
• Self-Paced
• Free Video

Realtime Stock Market Anomaly Detection Using Machine Learning - End-to-End Data Engineering Project

Develop an end-to-end data engineering project for real-time stock market anomaly detection using Quix Streams, Redpanda, and Docker. Learn to build a complete data pipeline and deploy an advanced ML model.

• YouTube
• 1 hour 2 minutes
• Self-Paced
• Free Video

Building Realtime Data Warehouses from Scratch - End-to-End Data Engineering Project

Design and implement a real-time data warehouse with Apache Airflow, Kafka, and Pinot. Create custom hooks, ingest batch and streaming data, and visualize evolving data using Apache Superset.

• YouTube
• 2 hours 9 minutes
• Self-Paced
• Free Video