Real-time Logs Processing with Apache Airflow, Kafka and Elasticsearch - Part 1
CodeWithYu via YouTube
AI, Data Science & Cloud Certificates from Google, IBM & Meta
Power BI Fundamentals - Create visualizations and dashboards from scratch
Overview
AI, Data Science & Cloud Certificates from Google, IBM & Meta — 40% Off
One plan covers every Professional Certificate on Coursera. 40% off Coursera Plus Annual.
Unlock All Certificates
Learn to build a production-grade system for processing billions of real-time logs in this detailed video tutorial. Master the fundamentals of system architecture, website log production, and cloud infrastructure setup while exploring the integration of Apache Airflow, Kafka, and Elasticsearch. Follow along with hands-on demonstrations covering system architecture design, implementing log generation from websites, configuring a free Kafka cluster, and establishing a free Elasticsearch cluster. Gain practical experience through step-by-step instructions and comprehensive explanations that bridge the gap between theory and real-world implementation.
Syllabus
Introduction
System Architecture
Producing Logs from Websites
Setting up Free Kafka Cluster
Setting up Free Elasticsearch Cluster
Taught by
CodeWithYu