CodeWithYu Courses

End-to-End Modern Data Engineering with DBT and BigQuery

1 rating

Master modern data engineering with DBT and BigQuery. Set up, link, transform data, convert tables to views, seed data, write tests, and generate documentation in this comprehensive tutorial.

• YouTube
• 30 minutes
• Self-Paced
• Free Video

DevOps in Data Engineering: End-to-End Automation with CI/CD, Terraform and AWS - Part 1

Dive into end-to-end DevOps for data engineering with CI/CD pipelines, automated testing, and infrastructure as code using Terraform, GitHub Actions, and AWS to streamline your data workflows.

• YouTube
• 57 minutes
• Self-Paced
• Free Video

10-Step Roadmap to Become an Expert Data Engineer with Projects

Master a complete 10-step roadmap from beginner to expert data engineer with hands-on cloud projects across Azure, AWS, and GCP, covering essential tools, pipelines, architecture, and job preparation strategies.

• YouTube
• 37 minutes
• Self-Paced
• Free Video

Realtime Streaming for Anomaly Detection - An End-to-End Data Engineering Project

Build a real-time anomaly detection system using streaming data engineering techniques. Learn end-to-end implementation for monitoring and identifying unusual patterns in data streams.

• YouTube
• 1 hour 6 minutes
• Self-Paced
• Free Video

Monitoring High-Performance Systems with Real-Time Data Engineering - Part 1

Discover how to architect and monitor high-throughput data pipelines using Kafka, Spark, ELK Stack, and Prometheus for processing billions of records efficiently in real-time.

• YouTube
• 28 minutes
• Self-Paced
• Free Video

Monitoring High-Performance Data Pipelines with Elasticsearch - Part 1

Master high-throughput data pipeline monitoring using Elasticsearch, Filebeat, and Logstash. Set up real-time tracking for systems processing 1.2B records/hour while implementing effective log management and querying capabilities.

• YouTube
• 35 minutes
• Self-Paced
• Free Video

Real-time Logs Processing with Apache Airflow, Kafka and Elasticsearch - Part 1

Master real-time log processing by building a scalable system using Apache Airflow, Kafka, and Elasticsearch. Learn system architecture, website log production, and cluster setup for handling billions of records.

• YouTube
• 1 hour 25 minutes
• Self-Paced
• Free Video

End-to-End Monitoring with Prometheus, Grafana, Apache Kafka and Spark for Data Engineering

Master real-time monitoring setup for high-performance data pipelines using Prometheus, Grafana, Kafka, and Spark to process and track 1.2 billion records hourly through hands-on configuration and dashboard creation.

• YouTube
• 20 minutes
• Self-Paced
• Free Video

Realtime Stock Market Anomaly Detection Using Machine Learning - End-to-End Data Engineering Project

Develop an end-to-end data engineering project for real-time stock market anomaly detection using Quix Streams, Redpanda, and Docker. Learn to build a complete data pipeline and deploy an advanced ML model.

• YouTube
• 1 hour 2 minutes
• Self-Paced
• Free Video

Building Realtime Data Warehouses from Scratch - End-to-End Data Engineering Project

Design and implement a real-time data warehouse with Apache Airflow, Kafka, and Pinot. Create custom hooks, ingest batch and streaming data, and visualize evolving data using Apache Superset.

• YouTube
• 2 hours 9 minutes
• Self-Paced
• Free Video

Query Optimization for Data Engineers - End-to-End Walkthrough

Optimize SQL queries for data engineering projects using dbForge Studio. Learn database restoration, data generation, profiling, analysis, and design techniques in this comprehensive walkthrough.

• YouTube
• 52 minutes
• Self-Paced
• Free Video

Realtime Algorithmic Trading with Apache Flink - End-to-End Data Engineering Project

Develop an end-to-end algorithmic trading system using Apache Flink, Kafka, and Python. Learn real-time data processing, custom algorithms, and financial market insights.

• YouTube
• 1 hour 42 minutes
• Self-Paced
• Free Video

Realtime Streaming with Data Lakehouse - End-to-End Data Engineering Project

Design, implement, and maintain secure, scalable lakehouse architectures using Apache Spark, Kafka, Flink, Delta Lake, AWS, and open-source tools. Unlock data's potential through advanced analytics and machine learning.

• YouTube
• 1 hour 10 minutes
• Self-Paced
• Free Video

Building Data Lakehouse from Scratch - End-to-End Data Engineering Project

Design, implement, and maintain scalable lakehouse architectures using Apache Spark, Kafka, Flink, Delta Lake, AWS, and open-source tools. Enhance data potential through advanced analytics and machine learning.

• YouTube
• 55 minutes
• Self-Paced
• Free Video

Real Estate End-to-End Data Engineering Using AI

Build a real estate data engineering pipeline using AI, WebSocket, Docker, Kafka, Spark, and Cassandra. Learn to gather, process, and store property data in real-time with advanced tools and techniques.

• YouTube
• 2 hours 8 minutes
• Self-Paced
• Free Video