Engineering Courses and Certifications

NPTEL-NOC IITM

Software Defined Networking: Traffic Engineering Problems and SDN Architecture - Part 1

Explore traffic engineering challenges, SDN architecture, and controller functionality in modern networking paradigms.

• YouTube
• 19 minutes
• Self-Paced
• Free Video

CodeWithYu

Building Realtime Data Warehouses from Scratch - End-to-End Data Engineering Project

Design and implement a real-time data warehouse with Apache Airflow, Kafka, and Pinot. Create custom hooks, ingest batch and streaming data, and visualize evolving data using Apache Superset.

• YouTube
• 2 hours 9 minutes
• Self-Paced
• Free Video

CodeWithYu

Realtime Algorithmic Trading with Apache Flink - End-to-End Data Engineering Project

Develop an end-to-end algorithmic trading system using Apache Flink, Kafka, and Python. Learn real-time data processing, custom algorithms, and financial market insights.

• YouTube
• 1 hour 42 minutes
• Self-Paced
• Free Video

CodeWithYu

Realtime Streaming with Data Lakehouse - End-to-End Data Engineering Project

Design, implement, and maintain secure, scalable lakehouse architectures using Apache Spark, Kafka, Flink, Delta Lake, AWS, and open-source tools. Unlock data's potential through advanced analytics and machine learning.

• YouTube
• 1 hour 10 minutes
• Self-Paced
• Free Video

CodeWithYu

Building Data Lakehouse from Scratch - End-to-End Data Engineering Project

Design, implement, and maintain scalable lakehouse architectures using Apache Spark, Kafka, Flink, Delta Lake, AWS, and open-source tools. Enhance data potential through advanced analytics and machine learning.

• YouTube
• 55 minutes
• Self-Paced
• Free Video

CodeWithYu

CI/CD for Modern Data Engineering - End-to-End Project on Azure with Terraform

Implement CI/CD for modern data engineering using Azure and Terraform. Automate infrastructure, storage, and data factory deployment with hands-on guidance and practical examples.

• YouTube
• 1 hour 10 minutes
• Self-Paced
• Free Video

CodeWithYu

Apache Flink for Sales Analytics - End-to-End Data Engineering Project

Develop an end-to-end sales analytics project using Apache Flink. Learn data ingestion, processing, complex transformations, and custom output formats for big data processing.

• YouTube
• 58 minutes
• Self-Paced
• Free Video

CodeWithYu

Apache Spark Processing with AWS EMR - Data Engineering Project

Master AWS EMR for data processing: set up, submit Spark jobs, visualize on Hadoop UI, and leverage cloud computing for efficient big data handling.

• YouTube
• 39 minutes
• Self-Paced
• Free Video

CodeWithYu

End-to-End Data Engineering on Azure Spark Cluster: Japan Visa Analysis

Set up Spark master-worker architecture in Docker on Azure, process and visualize Japan visa data using PySpark and Plotly. Clean, transform, and gain insights into visa trends through interactive data analysis.

• YouTube
• 59 minutes
• Self-Paced
• Free Video

CodeWithYu

Football Data Analytics with Tableau - Azure Data Engineering Project Part 3

Explore football data engineering: Extract Wikipedia data, store in Azure, migrate with Data Factory, query with Synapse, and visualize in Tableau. Master end-to-end data processes.

• YouTube
• 25 minutes
• Self-Paced
• Free Video

CodeWithYu

Football Data Analytics: Azure End-to-End Data Engineering Project - Part 2

Extract, store, and analyze football data using Azure services and Apache Airflow. Develop end-to-end data engineering skills through hands-on implementation of a real-world project.

• YouTube
• 1 hour
• Self-Paced
• Free Video

CodeWithYu

End-to-End Data Engineering with Apache Airflow, Docker, and Spark Clusters - Using Python, Scala, and Java

Build an end-to-end data engineering project using Apache Airflow, Docker, Spark Clusters, Scala, Python, and Java. Create and submit jobs in multiple languages to a Spark cluster for processing and real-time results.

• YouTube
• 12 minutes
• Self-Paced
• Free Video

Great Learning

Data Engineering Roadmap and Full Course with Python and SQL for 2024

Comprehensive guide to data engineering, covering Python, SQL, big data technologies, cloud platforms, and data warehousing tools. Includes hands-on tutorials and real-world projects for practical skill development.

• YouTube
• 10 hours 32 minutes
• Self-Paced
• Free Video

MIT HAN Lab

Efficient Fine-tuning and Prompt Engineering - Lecture 20

Explore efficient fine-tuning techniques and prompt engineering strategies for optimizing large language models in machine learning applications.

• YouTube
• 1 hour 18 minutes
• Self-Paced
• Free Video

MIT HAN Lab

Efficient Fine-tuning and Prompt Engineering - Lecture 20

Explore efficient fine-tuning techniques and prompt engineering strategies for optimizing large language models in machine learning applications.

• YouTube
• 1 hour 17 minutes
• Self-Paced
• Free Video