Compiler Plugins and Non-Native Execution Caching in Julia

Explore the evolution and challenges of compiler plugins in Julia during this 30-minute conference talk. Delve into the history of compiler plugins, starting with approaches like Cassette.jl and IRTools.jl, and progressing to tools that extend the compiler interface and method overlay tables. Examine the current limitations of within-session caching and the need for across-session caching to reduce latency spikes. Learn about Julia's caching infrastructure, the challenges involved, and a proposed solution for non-native caching. Discuss the potential for solving non-native code execution problems through advancements in non-native caching. Gain insights into the future of compiler plugins and their impact on Julia's performance and functionality.