In this video, we review the new Orca Mini 13b model. This is an unofficial implementation of the Orca research paper from Microsoft research published a couple weeks ago. I'll show you how to install it and we'll test it out. As you can tell from the thumbnail and title, it didn't do well. To be clear, I appreciate the author's work on this and it does not bring me joy to give a negative review. I know how much effort goes into building models so I hope the author continues to bring us new open source work. thank you.
Enjoy 🙂
Become a Patron 🔥 –
Join the Discord 💬 –
Follow me on Twitter 🧠 –
Subscribe to my Substack 🗞️ –
Links:
Orca Research Paper –
Orca Mini –
Quantized Version –
TextGen WebUI –
Runpod –
Runpod The Bloke Template –
