Building an Orca Mini and Phi 3 Chatbot with Python on Raspberry Pi 5

Discover how to create a locally-running chatbot on a Raspberry Pi 5 using Python with Orca Mini 3B and Phi 3 Mini 4K Instruct models in this 11-minute video tutorial. Follow along as the process is broken down into key steps, including Raspberry Pi OS setup, using the Hugging Face memory model calculator, downloading and installing the Orca Mini model and required libraries, and writing the Python program to run Orca. As a bonus, learn how to modify the setup to use the Phi 3 Mini model. Gain hands-on experience in building an offline chatbot without the need for an internet connection or subscription, and explore additional resources provided for further learning and community engagement in the Arm software development ecosystem.

Intro
Raspberry Pi OS setup
Hugging Face memory model calculator
Download and install Orca Mini model and required libraries
The Python program to run Orca
Bonus: Modify to use Phi 3 Mini and the Python program to run it