2 Billion Objects, Multi Region Sync - Pushing Ceph RGW to Hyperscaler Scale
OpenInfra Foundation via YouTube
Start speaking a new language. It’s just 3 weeks away.
Google AI Professional Certificate - Learn AI Skills That Get You Hired
Overview
Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Learn how to scale open-source object storage to hyperscaler levels through a comprehensive conference talk examining Ceph RGW's capabilities for massive multi-region deployments. Discover the technical achievements of syncing over 2 billion objects in a single bucket across geographically distributed Ceph RGW zones, demonstrating that open-source solutions can compete with commercial hyperscaler storage services. Explore the detailed testbed setup used to validate Ceph RGW's dynamic resharding capabilities and multisite synchronization under production-like stress conditions. Understand the critical scaling techniques required to push beyond default shard and omap limits, including performance optimizations and key upstream improvements that enable enterprise-scale deployments. Examine real-world use cases for Ceph S3 as a vendor-neutral storage solution, including multi-region disaster recovery strategies, multi-tenancy implementations with federated identity management, and large-scale S3 data lakes optimized for AI/ML and scientific computing workloads. Gain insights into hybrid and federated cloud architectures that leverage Ceph's integration with OpenStack and edge-to-core workflows, providing practical guidance for architects and operators building open, scalable, multi-tenant storage infrastructure across multiple clouds and geographic regions.
Syllabus
2 Billion Objects, Multi Region Sync: Pushing Ceph RGW to Hyperscaler Scale
Taught by
OpenInfra Foundation