Docker Model Runner Explained - Run AI Models Anywhere
What is Docker Model Runner and why should you care? Docker’s new Model Runner makes it easy to run and develop with AI models, no messy dependencies or complicated setup. In this video, I’ll walk you through everything from getting started in the CLI, using it with Docker Compose, and developing locally with my open-source Next.js app techno-boto-chat. Big thanks to Docker for sponsoring this video
Try Docker Model Runner for free: https://dockr.ly/4nOGjdm
Download Docker Desktop: https://dockr.ly/4nQHOYq
Video Notes: https://technotim.live/posts/docker-m...
Merch Shop 🛍️: https://l.technotim.live/shop
Support me on Patreon:
/ technotim
Sponsor me on GitHub: https://github.com/sponsors/timothyst...
Subscribe on Twitch:
/ technotim
Become a YouTube member:
/ @technotim
Gear Recommendations: https://l.technotim.live/gear
Get Help in Our Discord Community: https://l.technotim.live/discord
2nd channel:
/ @technotimtinkers
(Affiliate links may be included in this description. I may receive a small commission at no cost to you.)
00:00 - Intro: Why Docker Model Runner?
01:15 - What Is Docker Model Runner?
02:05 - Getting Started (CLI Basics)
03:47 - Using Docker Model Runner with Compose
04:30 - OpenWebUI with Docker Model Runner
05:54 - Developing locally with my techno-boto-chat
08:15 - Starting and configuring the application
10:07 - Running the application with NodeJS
11:59 - Docker Model Runner logging and debugging
14:10 - Running techno-boto-chat with Docker Compose
16:31 - Outro & Final Thoughts