Multi-App Compositing With Unreal Engine, OpenXR, and Varjo

Discover how to create sophisticated, layered simulations by combining Unreal Engine with Varjo's native multi-app capabilities and future OpenXR extensions in this conference talk from Unreal Fest Stockholm. Learn to seamlessly integrate outputs from diverse engines and image generators while controlling the final view through prioritized rendering, where higher priority applications overlay lower priority ones. Explore practical applications including merging detailed Unreal cockpits with dedicated terrain generators for advanced training scenarios, overlaying interactive design elements onto existing virtual scenes using markers, and running analytics like eye tracking concurrently with primary visual applications. Master techniques for incorporating real-world elements using video passthrough and custom chroma key masking to create powerful mixed reality training environments, such as compositing a real cockpit into a virtual world. Understand the crucial performance implications inherent in running multiple demanding applications simultaneously and learn optimization strategies for maintaining smooth operation across complex multi-app compositions.