{"id":2252,"date":"2025-07-16T12:22:04","date_gmt":"2025-07-16T12:22:04","guid":{"rendered":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/2025\/07\/16\/powering-local-ai-together-docker-model-runner-on-hugging-face\/"},"modified":"2025-07-16T12:22:04","modified_gmt":"2025-07-16T12:22:04","slug":"powering-local-ai-together-docker-model-runner-on-hugging-face","status":"publish","type":"post","link":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/2025\/07\/16\/powering-local-ai-together-docker-model-runner-on-hugging-face\/","title":{"rendered":"Powering Local AI Together: Docker Model Runner on Hugging Face"},"content":{"rendered":"

At Docker, we always believe in the power of community and collaboration. It reminds me of what Robert Axelrod said in The Evolution of Cooperation<\/em>: \u201cThe key to doing well lies not in overcoming others, but in eliciting their cooperation.\u201d And what better place for Docker Model Runner<\/a> to foster this cooperation than at Hugging Face, the well-known gathering place for the AI, ML, and data science community. We\u2019re excited to share that developers can use Docker Model Runner as the local inference engine for running models and filtering for Model Runner supported models on Hugging Face!<\/p>\n

Of course, Docker Model Runner has supported pulling models directly from HuggingFace repositories for some time now:<\/p>\n

\ndocker model pull hf.co\/bartowski\/Llama-3.2-1B-Instruct-GGUF\n<\/div>\n

Local Inference with Model Runner on Hugging Face<\/h2>\n

But so far, it has been cumbersome to rummage through the vast collection of models available at HuggingFace and find repositories that work with Docker Model Runner. But not anymore! HuggingFace now supports Docker as a Local Apps provider, so you can select it as the local inference engine to run models. And you don\u2019t even have to configure it in your account; it is already selected as a default Local Apps provider for all users.<\/p>\n

<\/div>\n

Figure 1: Docker Model Runner is a new inference engine available in Hugging Face for running local models.<\/strong><\/p>\n

This makes running a model directly from HuggingFace as easy as visiting a repository page, selecting Docker Model Runner as the Local Apps provider, and executing the provided snippet:<\/p>\n

<\/div>\n

Figure 2: Running models from Hugging Face using Docker Model Runner is now a breeze!<\/strong><\/p>\n

You can even get the list of all models supported by Docker Model Runner (meaning repositories containing models in GGUF format) through a search filter<\/a>!<\/p>\n

<\/div>\n

Figure 3: Easily discover models supported by Docker Model Runner with a search filter in Hugging Face<\/strong><\/p>\n

We are very happy that HuggingFace is now a first-class source for Docker Model Runner models, making model discovery as routine as pulling a container image. It\u2019s a small change, but one that quietly shortens the distance between research and runnable code.<\/p>\n

Conclusion<\/h3>\n

With Docker Model Runner now directly integrated on Hugging Face, running local inference just got a whole lot more convenient. Developers can filter for compatible models, pull them with a single command, and get the run command directly from the Hugging Face UI using Docker Model Runner as the Local Apps engine. This tighter integration makes model discovery and execution feel as seamless as pulling a container image.\u00a0<\/p>\n

And coming back to Robert Axelrod and The Evolution of Cooperation, Docker Model Runner has been an open-source project from the very beginning, and we are interested in building it together with the community. So head over to GitHub, check out our repositories<\/a>, log issues and suggestions, and let\u2019s keep on building the future together.<\/p>\n

Learn more<\/h3>\n

\n<\/p>

Get an inside look at the design architecture of the Docker Model Runner<\/a>.\u00a0<\/p>\n

Explore the story<\/a> behind our model distribution specification<\/p>\n

Read our quickstart guide to Docker Model Runner<\/a>.<\/p>\n

Find documentation for Model Runner<\/a>.<\/p>\n

Visit our new AI solution page<\/a><\/p>\n

New to Docker? Create an account<\/a>.\u00a0<\/p>","protected":false},"excerpt":{"rendered":"

At Docker, we always believe in the power of community and collaboration. It reminds me of what Robert Axelrod said […]<\/p>\n","protected":false},"author":0,"featured_media":0,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","ast-disable-related-posts":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":""},"categories":[4],"tags":[],"class_list":["post-2252","post","type-post","status-publish","format-standard","hentry","category-docker"],"_links":{"self":[{"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/posts\/2252","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/comments?post=2252"}],"version-history":[{"count":0,"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/posts\/2252\/revisions"}],"wp:attachment":[{"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/media?parent=2252"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/categories?post=2252"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/tags?post=2252"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}