Scale Out Networks and Scale Up Architectures with Co-Packaged Optics

Learn how Co-Packaged Optics (CPO) technology addresses the critical limitations of compute provisioning in modern data center architectures through this 16-minute conference talk. Explore the fundamental challenges facing scale-up domain expansion, including power constraints, rack density limitations, and the bandwidth, weight, and reach restrictions of traditional copper interconnects. Discover how CPO enables scale-up domains exceeding 512 nodes while meeting the stringent bandwidth, power, and latency requirements necessary for supporting increasingly large model parameter sizes. Examine the strategic deployment approach for CPO technology, starting with backend scale-out networks to gain operational experience before transitioning to more demanding scale-up interconnect environments where link failures and operational issues have severe consequences. Gain insights into real-world implementation challenges and solutions through specific examples from Broadcom's 51.2 Tbps TH5-Bailly CPO development, covering the transition from prototype to production including optimization of fiber routing, thermal management, test yield improvements, and box design considerations. Understand the roadmap for bringing CPO technology to scale-up domains and the technical considerations required for successful deployment in these critical infrastructure components.