Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Rust-Powered Data Lakes - High-Performance Infrastructure

Conf42 via YouTube

Overview

Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Explore the evolution of enterprise data architecture and discover how Rust is revolutionizing modern data lake infrastructure in this 14-minute conference talk from Conf42 Rustlang 2025. Trace the journey from on-premise Hadoop systems through cloud data warehouses to today's lakehouse architecture, understanding the challenges and limitations of each phase. Learn why Rust's memory safety, performance characteristics, and zero-cost abstractions make it an ideal choice for building high-performance data infrastructure components. Examine practical implementation patterns for integrating Rust into data processing pipelines, storage systems, and analytics workloads. Gain insights into how Rust addresses common pain points in data engineering such as memory management, concurrency, and system-level performance optimization. Understand the specific advantages Rust brings to data lake architectures, including improved resource utilization, reduced operational overhead, and enhanced reliability for large-scale data processing systems.

Syllabus

00:00 Introduction and Speaker Background
00:29 Evolution of Enterprise Data Architecture
00:41 Phase One: On-Premise Hadoop Era
04:30 Phase Two: Cloud Data Warehouses
07:17 Phase Three: Modern Lakehouse Architecture
08:17 Rust's Role in Modern Data Infrastructure
10:36 Practical Implementation Patterns for Rust
12:27 Key Takeaways and Next Steps
13:33 Conclusion and Final Thoughts

Taught by

Conf42

Reviews

Start your review of Rust-Powered Data Lakes - High-Performance Infrastructure

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.