Unified Memory Framework: A Unified API for Diverse Memory Technologies

Learn about the open-source Unified Memory Framework (UMF) in this technical talk that explores middleware solutions for emerging memory technologies. Discover how UMF provides consistent mechanisms for software developers to work with memory hierarchies and functions, enabling the construction of allocators and memory pools across CPU and GPU domains. Explore the framework's capability to create and manage multiple memory pools with different attributes, allowing for isolated allocation types and hardware resource utilization. Examine how the flexible mix-and-match API leverages CXL memory, HBM on CPU, and Unified Shared Memory on GPU. Through a case study, see how the oneAPI software stack utilizes UMF as an infrastructure layer to enhance interoperability between higher-level runtimes.