Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Designing High-Performance Multi-Hop Data Pipelines

Conf42 via YouTube

Overview

Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Learn to architect and optimize multi-hop data pipelines for high-performance big data processing in this conference talk from Conf42 Golang 2025. Explore the fundamental concepts of big data pipeline hops and understand how data flows through multiple stages of processing and transformation. Master core design principles that ensure reliability, scalability, and maintainability in your data architecture. Discover popular technologies and frameworks commonly used for building robust data pipelines, with insights into their strengths and use cases. Dive into performance optimization techniques that can significantly improve pipeline throughput and reduce latency. Address common scaling challenges and learn proven solutions for handling increasing data volumes and complexity. Implement comprehensive monitoring and observability practices to maintain pipeline health and quickly identify bottlenecks or failures. Gain practical insights from real-world experience in designing enterprise-grade data processing systems that can handle massive scale while maintaining performance and reliability.

Syllabus

00:00 Introduction to Big Data Pipelines
00:14 Meet Your Instructor: Hardik Patel
00:46 Understanding Big Data Pipeline Hops
02:37 Core Design Principles of Data Pipelines
04:01 Popular Technologies for Building Data Pipelines
05:37 Performance Optimization Techniques
06:43 Scaling Challenges and Solutions
08:35 Monitoring and Observability
10:02 Key Takeaways
10:55 Conclusion

Taught by

Conf42

Reviews

Start your review of Designing High-Performance Multi-Hop Data Pipelines

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.