Moxin - All-In-One Tool for Running LLMs on Personal Devices

Explore the innovative Moxin project, an open-source tool designed to run Large Language Models (LLMs) on personal computers, in this 39-minute talk by Michael Yuan from Second State. Learn about Moxin's Rust-based GUI for rich interactions, its backend service utilizing WasmEdge Runtime for GPU acceleration, and the LLM database providing up-to-date metadata and benchmark results. Discover the design decisions behind Moxin, its potential as a template for cross-platform LLM applications, and gain insights into building rich UI applications and LLM services in Rust.