Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Explore the architecture and implementation challenges of SDFS, the masterless distributed filesystem powering Rubrik's cybersecurity platform that protects mission-critical data for thousands of global customers including banks, hospitals, and government agencies. Learn how this FUSE-based filesystem addresses the complex challenges of building a scalable system that maintains data resilience, strong data integrity, and high performance across diverse hardware configurations and cloud platforms. Discover the technical details of how erasure coding is leveraged for data resilience and checksum schemes ensure data integrity while maintaining optimal performance. Understand the continuous monitoring and maintenance strategies required to preserve filesystem health in terms of data resilience, integrity, and load balancing. Examine the processes for online resource expansion and contraction, and explore how native priority support enables the filesystem to handle various workloads and background operations with different SLA requirements. Gain insights into the benefits and challenges of implementing encryption, compression, and deduplication natively within the filesystem architecture. The presentation covers the critical balance between resilience, data integrity, and performance in distributed systems, details the background operations necessary for maintaining steady-state data resilience and balance, addresses design challenges for systems operating across varied hardware specifications, and explains how native priority mechanisms differentiate clients to achieve specific performance objectives.
