Building an Orca Mini and Phi 3 Chatbot with Python on Raspberry Pi 5
Arm Software Developers via YouTube
Google Data Analytics, IBM AI & Meta Marketing — All in One Subscription
Master AI and Machine Learning: From Neural Networks to Applications
Overview
Google, IBM & Meta Certificates — All 10,000+ Courses at 40% Off
One annual plan covers every course and certificate on Coursera. 40% off for a limited time.
Get Full Access
Discover how to create a locally-running chatbot on a Raspberry Pi 5 using Python with Orca Mini 3B and Phi 3 Mini 4K Instruct models in this 11-minute video tutorial. Follow along as the process is broken down into key steps, including Raspberry Pi OS setup, using the Hugging Face memory model calculator, downloading and installing the Orca Mini model and required libraries, and writing the Python program to run Orca. As a bonus, learn how to modify the setup to use the Phi 3 Mini model. Gain hands-on experience in building an offline chatbot without the need for an internet connection or subscription, and explore additional resources provided for further learning and community engagement in the Arm software development ecosystem.
Syllabus
Intro
Raspberry Pi OS setup
Hugging Face memory model calculator
Download and install Orca Mini model and required libraries
The Python program to run Orca
Bonus: Modify to use Phi 3 Mini and the Python program to run it
Taught by
Arm Software Developers