{"id":2986,"date":"2025-12-05T14:13:27","date_gmt":"2025-12-05T14:13:27","guid":{"rendered":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/2025\/12\/05\/announcing-vllm-v0-12-0-ministral-3-and-deepseek-v3-2-for-docker-model-runner\/"},"modified":"2025-12-05T14:13:27","modified_gmt":"2025-12-05T14:13:27","slug":"announcing-vllm-v0-12-0-ministral-3-and-deepseek-v3-2-for-docker-model-runner","status":"publish","type":"post","link":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/2025\/12\/05\/announcing-vllm-v0-12-0-ministral-3-and-deepseek-v3-2-for-docker-model-runner\/","title":{"rendered":"Announcing vLLM v0.12.0, Ministral 3 and DeepSeek-V3.2 for Docker Model Runner"},"content":{"rendered":"<p>At Docker, we are committed to making the AI development experience as seamless as possible. Today, we are thrilled to announce two major updates that bring state-of-the-art performance and frontier-class models directly to your fingertips: the immediate availability of <strong>Mistral AI\u2019s <\/strong><a href=\"https:\/\/hub.docker.com\/r\/ai\/ministral3\" rel=\"nofollow noopener\" target=\"_blank\"><strong>Ministral 3<\/strong><\/a> and <a href=\"https:\/\/hub.docker.com\/r\/ai\/deepseek-v3.2-vllm\" rel=\"nofollow noopener\" target=\"_blank\"><strong>DeepSeek-V3.2<\/strong><\/a>, alongside the release of <strong>vLLM v0.12.0<\/strong> on Docker Model Runner.<\/p>\n<p>Whether you are building high-throughput serving pipelines or experimenting with edge-optimized agents on your laptop, today\u2019s updates are designed to accelerate your workflow.<\/p>\n<h3 class=\"wp-block-heading\"><strong>Meet Ministral 3: Frontier Intelligence, Edge Optimized<\/strong><\/h3>\n<div class=\"wp-block-ponyo-image\">\n            <img data-opt-id=1796814433  fetchpriority=\"high\" decoding=\"async\" width=\"1000\" height=\"694\" src=\"https:\/\/www.docker.com\/app\/uploads\/2025\/12\/vLLM-2nd-blog-image-1.png\" class=\"fade-in attachment-full size-full\" alt=\"vLLM 2nd blog image 1\" title=\"- vLLM 2nd blog image 1\" \/>\n    <\/div>\n<p>While vLLM powers your production infrastructure, we know that development needs speed and efficiency <em>right now<\/em>. That\u2019s why we are proud to add Mistral AI\u2019s newest marvel, <strong>Ministral 3<\/strong>, to the Docker Model Runner library on <a href=\"https:\/\/hub.docker.com\/u\/ai\" rel=\"nofollow noopener\" target=\"_blank\">Docker Hub<\/a>.<\/p>\n<p>Ministral 3 is Mistral AI\u2019s premier edge model. It packs frontier-level reasoning and capabilities into a dense, efficient architecture designed specifically for local inference. It is perfect for:<\/p>\n<ul class=\"wp-block-list\">\n<li><strong>Local RAG applications:<\/strong> Chat with your docs without data leaving your machine.<\/li>\n<li><strong>Agentic Workflows:<\/strong> Fast reasoning steps for complex function-calling agents.<\/li>\n<li><strong>Low-latency prototyping:<\/strong> Test ideas instantly without waiting for API calls.<\/li>\n<\/ul>\n<h3 class=\"wp-block-heading\"><strong>DeepSeek-V3.2: The Open Reasoning Powerhouse<\/strong><\/h3>\n<div class=\"wp-block-ponyo-image\">\n            <img data-opt-id=2022229935  fetchpriority=\"high\" decoding=\"async\" width=\"1000\" height=\"658\" src=\"https:\/\/www.docker.com\/app\/uploads\/2025\/12\/vLLM-2nd-blog-image-2.png\" class=\"fade-in attachment-full size-full\" alt=\"vLLM 2nd blog image 2\" title=\"- vLLM 2nd blog image 2\" \/>\n    <\/div>\n<p>We are equally excited to introduce support for <strong>DeepSeek-V3.2<\/strong>. Known for pushing the boundaries of what open-weights models can achieve, the DeepSeek-V3 series has quickly become a favorite for developers requiring high-level reasoning and coding proficiency.<\/p>\n<p>DeepSeek-V3.2 brings Mixture-of-Experts (MoE) architecture efficiency to your local environment, delivering performance that rivals top-tier closed models. It is the ideal choice for:<\/p>\n<ul class=\"wp-block-list\">\n<li><strong>Complex Code Generation:<\/strong> Build and debug software with a model specialized in programming tasks.<\/li>\n<li><strong>Advanced Reasoning:<\/strong> Tackle complex logic puzzles, math problems, and multi-step instructions.<\/li>\n<li><strong>Data Analysis:<\/strong> Process and interpret structured data with high precision.<\/li>\n<\/ul>\n<h3 class=\"wp-block-heading\"><strong>Run Them with One Command<\/strong><\/h3>\n<p>With Docker Model Runner, you don\u2019t need to worry about complex environment setups, python dependencies, or weight downloads. We\u2019ve packaged both models so you can get started immediately.<\/p>\n<p><strong>To run Ministral 3:<\/strong><\/p>\n<div class=\"wp-block-syntaxhighlighter-code \">\n<pre class=\"brush: bash; gutter: false; title: ; notranslate\">\ndocker model run ai\/ministral3\n<\/pre>\n<\/div>\n<p><strong>To run DeepSeek-V3.2:<\/strong><\/p>\n<div class=\"wp-block-syntaxhighlighter-code \">\n<pre class=\"brush: bash; gutter: false; title: ; notranslate\">\ndocker model run ai\/deepseek-v3.2-vllm\n<\/pre>\n<\/div>\n<p>These commands automatically pull the model, set up the runtime, and drop you into an interactive chat session. You can also point your applications to them using our OpenAI-compatible local endpoint, making them drop-in replacements for your cloud API calls during development.<\/p>\n<h3 class=\"wp-block-heading\"><strong>vLLM v0.12.0: Faster, Leaner, and Ready for What\u2019s Next<\/strong><\/h3>\n<div class=\"wp-block-ponyo-image\">\n            <img data-opt-id=943667618  data-opt-src=\"https:\/\/www.docker.com\/app\/uploads\/2025\/11\/vLLM-blog-1.png\"  decoding=\"async\" width=\"1000\" height=\"287\" src=\"data:image/svg+xml,%3Csvg%20viewBox%3D%220%200%20100%%20100%%22%20width%3D%22100%%22%20height%3D%22100%%22%20xmlns%3D%22http%3A%2F%2Fwww.w3.org%2F2000%2Fsvg%22%3E%3Crect%20width%3D%22100%%22%20height%3D%22100%%22%20fill%3D%22transparent%22%2F%3E%3C%2Fsvg%3E\" class=\"fade-in attachment-full size-full\" alt=\"vLLM blog 1\" title=\"- vLLM blog 1\" \/>\n    <\/div>\n<p>We are excited to highlight the release of <strong>vLLM v0.12.0<\/strong>. vLLM has quickly become the gold standard for high-throughput and memory-efficient LLM serving, and this latest version raises the bar again.<\/p>\n<p>Version 0.12.0 brings critical enhancements to the engine, including:<\/p>\n<ul class=\"wp-block-list\">\n<li><strong>Expanded Model Support:<\/strong> Day-0 support for the latest architecture innovations, ensuring you can run the newest open-weights models (like DeepSeek V3.2 and Ministral 3) the moment they drop.<\/li>\n<li><strong>Optimized Kernels:<\/strong> Significant latency reductions for inference on NVIDIA GPUs, making your containerized AI applications snappier than ever.<\/li>\n<li><strong>Enhanced PagedAttention:<\/strong> Further optimizations to memory management, allowing you to batch more requests and utilize your hardware to its full potential.<\/li>\n<\/ul>\n<h3 class=\"wp-block-heading\"><strong>Why This Matters<\/strong><\/h3>\n<p>The combination of <strong>Ministral 3<\/strong>, <strong>DeepSeek-V3.2<\/strong>, and <strong>vLLM v0.12.0<\/strong> represents the maturity of the open AI ecosystem.<\/p>\n<p>You now have access to a serving engine that maximizes data center performance, alongside a choice of models to fit your specific needs\u2014whether you prioritize the edge-optimized speed of Ministral 3 or the deep reasoning power of DeepSeek-V3.2. All of this is easily accessible via Docker Model Runner.<\/p>\n<h3 class=\"wp-block-heading\"><strong>How You Can Get Involved<\/strong><\/h3>\n<p>The strength of Docker Model Runner lies in its community, and there\u2019s always room to grow. We need your help to make this project the best it can be. To get involved, you can:<\/p>\n<ul class=\"wp-block-list\">\n<li><strong>Star the repository:<\/strong> Show your support and help us gain visibility by starring the<a href=\"https:\/\/github.com\/docker\/model-runner\" rel=\"nofollow noopener\" target=\"_blank\"> Docker Model Runner repo<\/a>.<\/li>\n<li><strong>Contribute your ideas:<\/strong> Have an idea for a new feature or a bug fix? Create an issue to discuss it. Or fork the repository, make your changes, and submit a pull request. We\u2019re excited to see what ideas you have!<\/li>\n<li><strong>Spread the word:<\/strong> Tell your friends, colleagues, and anyone else who might be interested in running AI models with Docker.<\/li>\n<\/ul>\n<p>We\u2019re incredibly excited about this new chapter for Docker Model Runner, and we can\u2019t wait to see what we can build together. Let\u2019s get to work!<\/p>","protected":false},"excerpt":{"rendered":"<p>At Docker, we are committed to making the AI development experience as seamless as possible. Today, we are thrilled to [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":2987,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","ast-disable-related-posts":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":""},"categories":[4],"tags":[],"class_list":["post-2986","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-docker"],"_links":{"self":[{"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/posts\/2986","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/comments?post=2986"}],"version-history":[{"count":0,"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/posts\/2986\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/media\/2987"}],"wp:attachment":[{"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/media?parent=2986"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/categories?post=2986"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/tags?post=2986"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}