Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Explore Amazon S3's internal data modernization journey in this conference talk from AWS re:Invent 2025, where AWS engineers share lessons learned from transforming their exabyte-scale data processing infrastructure. Discover how S3 internally handles hundreds of petabytes of data daily across microservices while generating millions of logs, and learn about their evolution from basic log analysis to a sophisticated Apache Iceberg-based data lake architecture. Examine the key architectural transitions including replacing legacy processing systems with SQL capabilities, migrating from unstructured text formats to structured Iceberg tables, and implementing enhanced data ingestion engines. Understand the decision-making frameworks used for technology format selection, maintaining backward compatibility, and ensuring operational continuity during complex large-scale migrations. Gain practical insights and proven strategies for your own data modernization initiatives, including technology selection criteria, managing legacy system constraints, and maintaining business continuity throughout transformational infrastructure changes at enterprise scale.
