CodeWithYu Courses

End-to-End Modern Data Engineering with DBT and BigQuery

1 rating

Master modern data engineering with DBT and BigQuery. Set up, link, transform data, convert tables to views, seed data, write tests, and generate documentation in this comprehensive tutorial.

• YouTube
• 30 minutes
• Self-Paced
• Free Video

Realtime Streaming for Anomaly Detection - An End-to-End Data Engineering Project

Build a real-time anomaly detection system using streaming data engineering techniques. Learn end-to-end implementation for monitoring and identifying unusual patterns in data streams.

• YouTube
• 1 hour 6 minutes
• Self-Paced
• Free Video

Monitoring High-Performance Systems with Real-Time Data Engineering - Part 1

Discover how to architect and monitor high-throughput data pipelines using Kafka, Spark, ELK Stack, and Prometheus for processing billions of records efficiently in real-time.

• YouTube
• 28 minutes
• Self-Paced
• Free Video

10-Step Roadmap to Become an Expert Data Engineer with Projects

Master a complete 10-step roadmap from beginner to expert data engineer with hands-on cloud projects across Azure, AWS, and GCP, covering essential tools, pipelines, architecture, and job preparation strategies.

• YouTube
• 37 minutes
• Self-Paced
• Free Video

Building a High-Performance Real-Time Analytics Database with Apache Kafka and Druid

Master building a real-time analytics database using Apache ecosystem tools including Kafka, Druid, and Superset. Learn data streaming, processing, and containerization with hands-on implementation.

• YouTube
• 1 hour 11 minutes
• Self-Paced
• Free Video

Monitoring High-Performance Data Pipelines with Elasticsearch - Part 1

Master high-throughput data pipeline monitoring using Elasticsearch, Filebeat, and Logstash. Set up real-time tracking for systems processing 1.2B records/hour while implementing effective log management and querying capabilities.

• YouTube
• 35 minutes
• Self-Paced
• Free Video

End-to-End Monitoring with Prometheus, Grafana, Apache Kafka and Spark for Data Engineering

Master real-time monitoring setup for high-performance data pipelines using Prometheus, Grafana, Kafka, and Spark to process and track 1.2 billion records hourly through hands-on configuration and dashboard creation.

• YouTube
• 20 minutes
• Self-Paced
• Free Video

Real-time Logs Processing with Apache Airflow, Kafka and Elasticsearch - Part 1

Master real-time log processing by building a scalable system using Apache Airflow, Kafka, and Elasticsearch. Learn system architecture, website log production, and cluster setup for handling billions of records.

• YouTube
• 1 hour 25 minutes
• Self-Paced
• Free Video

High-Performance Data Engineering with Kafka and Spark - Processing 1.2 Billion Records Per Hour

Master high-performance data engineering by building a system processing 1.2B records/hour using Kafka, Spark, ELK Stack, and monitoring tools. Includes architecture design, implementation, and optimization strategies.

• YouTube
• 2 hours 18 minutes
• Self-Paced
• Free Video

DevOps in Data Engineering: End-to-End Automation with CI/CD, Terraform and AWS - Part 1

Dive into end-to-end DevOps for data engineering with CI/CD pipelines, automated testing, and infrastructure as code using Terraform, GitHub Actions, and AWS to streamline your data workflows.

• YouTube
• 57 minutes
• Self-Paced
• Free Video

Realtime Stock Market Anomaly Detection Using Machine Learning - End-to-End Data Engineering Project

Develop an end-to-end data engineering project for real-time stock market anomaly detection using Quix Streams, Redpanda, and Docker. Learn to build a complete data pipeline and deploy an advanced ML model.

• YouTube
• 1 hour 2 minutes
• Self-Paced
• Free Video

Building Realtime Data Warehouses from Scratch - End-to-End Data Engineering Project

Design and implement a real-time data warehouse with Apache Airflow, Kafka, and Pinot. Create custom hooks, ingest batch and streaming data, and visualize evolving data using Apache Superset.

• YouTube
• 2 hours 9 minutes
• Self-Paced
• Free Video

Query Optimization for Data Engineers - End-to-End Walkthrough

Optimize SQL queries for data engineering projects using dbForge Studio. Learn database restoration, data generation, profiling, analysis, and design techniques in this comprehensive walkthrough.

• YouTube
• 52 minutes
• Self-Paced
• Free Video

Realtime Algorithmic Trading with Apache Flink - End-to-End Data Engineering Project

Develop an end-to-end algorithmic trading system using Apache Flink, Kafka, and Python. Learn real-time data processing, custom algorithms, and financial market insights.

• YouTube
• 1 hour 42 minutes
• Self-Paced
• Free Video

Realtime Streaming with Data Lakehouse - End-to-End Data Engineering Project

Design, implement, and maintain secure, scalable lakehouse architectures using Apache Spark, Kafka, Flink, Delta Lake, AWS, and open-source tools. Unlock data's potential through advanced analytics and machine learning.

• YouTube
• 1 hour 10 minutes
• Self-Paced
• Free Video