Running Large Language Models on Raspberry Pi - Edge AI Implementation Guide
EDGE AI FOUNDATION via YouTube
Get 20% off all career paths from fullstack to AI
Learn Generative AI, Prompt Engineering, and LLMs for Free
Overview
AI, Data Science & Cloud Certificates from Google, IBM & Meta — 40% Off
One plan covers every Professional Certificate on Coursera. 40% off Coursera Plus Annual.
Unlock All Certificates
Learn how to deploy and run open source Large Language Models (LLMs) on Raspberry Pi devices in this 19-minute technical talk by Pete Warden, CEO of Useful Sensors. Discover the fundamentals of edge computing with LLMs, exploring various deployment options and understanding the associated tradeoffs. Gain practical insights into implementing ChatGPT-like models outside cloud environments, specifically focusing on Raspberry Pi 5 implementations. Explore real-world use cases, understand potential customer applications, and learn essential strategies for managing and mitigating hallucination risks in edge-based AI systems.
Syllabus
GenAI on the Edge Forum: Running an LLM on a Raspberry Pi
Taught by
EDGE AI FOUNDATION