Accelerating Frontier MoE Training with 3D Integrated Optics

Explore how 3D integrated optics can dramatically accelerate the training of Mixture of Experts (MoE) models in this 23-minute conference talk from the Hot Interconnects Symposium. Learn about cutting-edge optical interconnect technologies and their application to frontier-scale machine learning workloads, discovering how three-dimensional optical integration addresses the communication bottlenecks that traditionally limit MoE training performance. Gain insights into the technical challenges of scaling MoE architectures, understand the principles behind 3D optical interconnects, and examine how these advanced photonic solutions can enable more efficient training of large-scale AI models by providing the high-bandwidth, low-latency communication required for distributed expert routing and parameter updates.