Running Intelligence at the Edge - Web AI in Action

Explore how artificial intelligence is transitioning from cloud-based systems to browser-based implementations in this 17-minute conference talk from the Linux Foundation. Discover the latest advances in Web AI that enable powerful machine learning models for language processing, computer vision, and personalization to run directly on client devices. Learn about cutting-edge technologies including WebGPU and WebAssembly, and examine frameworks like ONNX.js and WebLLM that facilitate real-time, private, and serverless inference in web browsers. Understand how this technological shift delivers improved latency, enhanced user privacy, and eliminates infrastructure barriers while bringing scalable, intelligent experiences to the open web. Gain insights into open-source, privacy-first AI approaches that reduce cloud dependency, lower entry barriers for developers, and promote ethical, accessible AI development across various devices and platforms.