Overview
Coursera Spring Sale
40% Off Coursera Plus Annual!
Grab it
Explore the critical intersection of storage technology and AI workloads through a comprehensive analysis of Stable Diffusion's I/O patterns on NVMe-oF drives. Examine how generative AI models like Stable Diffusion create significant computational and storage demands in HPC environments, with particular focus on the I/O workload's impact on overall performance and scalability. Investigate various I/O patterns including read and write operations, latency, throughput, bandwidth, and LBA mappings, while understanding how Write Amplification Factor (WAF) influences generative AI workload performance. Discover how multiple concurrent user requests affect SSD WAF through detailed I/O pattern analysis. Learn about containerized Stable Diffusion deployment on FDP (Flexible Data Placement) enabled environments and how different storage configurations impact image generation efficiency while reducing WAF for both individual and concurrent user requests. Gain insights into a specialized tool that provides graphical visualization of logical block address (LBA) mapping, I/O hits, block size, and granular data access patterns for comprehensive I/O analysis. Understand deployment characteristics and I/O behavior of Stable Diffusion on NVMe-oF (RDMA/TCP) storage systems, study FDP and WAF influence in Stable Diffusion deployments, explore scaling workloads in containerized environments and their impact on model load times, and see demonstrations of utilities that provide detailed I/O activity insights including scatter diagrams of LBA mapping on storage systems.
Syllabus
SNIA SDC 2025 - Rethinking Storage for the AI/ML Era: Disaggregated Power with FDP
Taught by
SNIAVideo