CodeWithYu Courses

End-to-End Modern Data Engineering with DBT and BigQuery

1 review

Master modern data engineering with DBT and BigQuery. Set up, link, transform data, convert tables to views, seed data, write tests, and generate documentation in this comprehensive tutorial.

• YouTube
• 30 minutes
• On-Demand
• Free Video

Realtime Streaming for Anomaly Detection - An End-to-End Data Engineering Project

Build a real-time anomaly detection system using streaming data engineering techniques. Learn end-to-end implementation for monitoring and identifying unusual patterns in data streams.

• YouTube
• 1 hour 6 minutes
• On-Demand
• Free Video

Monitoring High-Performance Systems with Real-Time Data Engineering - Part 1

Discover how to architect and monitor high-throughput data pipelines using Kafka, Spark, ELK Stack, and Prometheus for processing billions of records efficiently in real-time.

• YouTube
• 28 minutes
• On-Demand
• Free Video

Real-time Logs Processing with Apache Airflow, Kafka and Elasticsearch - Part 1

Master real-time log processing by building a scalable system using Apache Airflow, Kafka, and Elasticsearch. Learn system architecture, website log production, and cluster setup for handling billions of records.

• YouTube
• 1 hour 25 minutes
• On-Demand
• Free Video

Monitoring High-Performance Data Pipelines with Elasticsearch - Part 1

Master high-throughput data pipeline monitoring using Elasticsearch, Filebeat, and Logstash. Set up real-time tracking for systems processing 1.2B records/hour while implementing effective log management and querying capabilities.

• YouTube
• 35 minutes
• On-Demand
• Free Video

Realtime Stock Market Anomaly Detection Using Machine Learning - End-to-End Data Engineering Project

Develop an end-to-end data engineering project for real-time stock market anomaly detection using Quix Streams, Redpanda, and Docker. Learn to build a complete data pipeline and deploy an advanced ML model.

• YouTube
• 1 hour 2 minutes
• On-Demand
• Free Video

Building Realtime Data Warehouses from Scratch - End-to-End Data Engineering Project

Design and implement a real-time data warehouse with Apache Airflow, Kafka, and Pinot. Create custom hooks, ingest batch and streaming data, and visualize evolving data using Apache Superset.

• YouTube
• 2 hours 9 minutes
• On-Demand
• Free Video

Query Optimization for Data Engineers - End-to-End Walkthrough

Optimize SQL queries for data engineering projects using dbForge Studio. Learn database restoration, data generation, profiling, analysis, and design techniques in this comprehensive walkthrough.

• YouTube
• 52 minutes
• On-Demand
• Free Video

Realtime Algorithmic Trading with Apache Flink - End-to-End Data Engineering Project

Develop an end-to-end algorithmic trading system using Apache Flink, Kafka, and Python. Learn real-time data processing, custom algorithms, and financial market insights.

• YouTube
• 1 hour 42 minutes
• On-Demand
• Free Video

Realtime Streaming with Data Lakehouse - End-to-End Data Engineering Project

Design, implement, and maintain secure, scalable lakehouse architectures using Apache Spark, Kafka, Flink, Delta Lake, AWS, and open-source tools. Unlock data's potential through advanced analytics and machine learning.

• YouTube
• 1 hour 10 minutes
• On-Demand
• Free Video

Building Data Lakehouse from Scratch - End-to-End Data Engineering Project

Design, implement, and maintain scalable lakehouse architectures using Apache Spark, Kafka, Flink, Delta Lake, AWS, and open-source tools. Enhance data potential through advanced analytics and machine learning.

• YouTube
• 55 minutes
• On-Demand
• Free Video

Real Estate End-to-End Data Engineering Using AI

Build a real estate data engineering pipeline using AI, WebSocket, Docker, Kafka, Spark, and Cassandra. Learn to gather, process, and store property data in real-time with advanced tools and techniques.

• YouTube
• 2 hours 8 minutes
• On-Demand
• Free Video

Designing Data Warehouse from Scratch - End-to-End Data Engineering

Master end-to-end data warehouse design, from logical architecture to physical implementation. Learn AWS Redshift, data loading, and medallion architecture for efficient data engineering.

• YouTube
• 2 hours 41 minutes
• On-Demand
• Free Video

Smart City End-to-End Realtime Data Engineering Project - AWS Data Engineer

Build a smart city real-time data pipeline using AWS, Apache tools, and Docker. Learn end-to-end data engineering from ingestion to visualization with PowerBI, covering IoT, streaming, and cloud technologies.

• YouTube
• 2 hours 27 minutes
• On-Demand
• Free Video

Kubernetes for Modern Data Engineering: An End-to-End Data Engineering Project

Master Kubernetes for data engineering: set up, deploy dashboard, run Apache Airflow with Helm charts. Learn kubectl, manage clusters, and optimize workflows for scalable data processing.

• YouTube
• 1 hour 25 minutes
• On-Demand
• Free Video