LLM 시스템에서 고용량 HBM의 성능 이득 탐색

Explore the performance advantages of high-capacity HBM (High Bandwidth Memory) in Large Language Model systems through this 19-minute conference talk from SK AI SUMMIT 2024. Learn why SK Hynix's HBM is positioned to become the market's sole choice due to its superior technical leadership in capacity. Delve into detailed research findings that demonstrate the performance benefits of high-capacity HBM across various LLM inference and training environments. Gain insights from speaker Jae-Young Jeon of SK Hynix, who brings extensive expertise in distributed computing, operating systems, memory management, memory hierarchy, memory reliability, and hardware logic design, with a current focus on analyzing Large Language Model systems.