{"id":1881,"date":"2025-04-01T17:53:35","date_gmt":"2025-04-01T17:53:35","guid":{"rendered":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/2025\/04\/01\/docker-desktop-4-40-model-runner-to-run-llms-locally-more-powerful-docker-ai-agent-and-expanded-ai-tools-catalog\/"},"modified":"2025-04-01T17:53:35","modified_gmt":"2025-04-01T17:53:35","slug":"docker-desktop-4-40-model-runner-to-run-llms-locally-more-powerful-docker-ai-agent-and-expanded-ai-tools-catalog","status":"publish","type":"post","link":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/2025\/04\/01\/docker-desktop-4-40-model-runner-to-run-llms-locally-more-powerful-docker-ai-agent-and-expanded-ai-tools-catalog\/","title":{"rendered":"Docker Desktop 4.40: Model Runner to run LLMs locally, more powerful Docker AI Agent, and expanded AI Tools Catalog"},"content":{"rendered":"

At Docker, we\u2019re focused on making life easier for developers and teams building high-quality applications, including those powered by generative AI. That\u2019s why, in the Docker Desktop 4.40<\/a> release, we\u2019re introducing new tools that simplify GenAI app development and support secure, scalable development.\u00a0<\/p>\n

Keep reading to find updates on new tooling like Model Runner and a more powerful Docker AI Agent with MCP capabilities. Plus, with the AI Tool Catalog, teams can now easily build smarter AI-powered applications and agents with MCPs. And with Docker Desktop Setting Reporting, admins now get greater visibility into compliance and policy enforcement.<\/p>\n

Docker Model Runner (Beta): Bringing local AI model execution to developers\u00a0<\/h2>\n

Now in beta with Docker Desktop 4.40, Docker Model Runner makes it easier for developers to run AI models locally. No extra setup, no jumping between tools, and no need to wrangle infrastructure. This first iteration is all about helping developers quickly experiment and iterate on models right from their local machines.<\/p>\n

The beta includes three core capabilities:<\/p>\n

Local model execution<\/strong>, right out of the box<\/p>\n

GPU acceleration<\/strong> on Apple Silicon for faster performance<\/p>\n

Standardized model packaging<\/strong> using OCI Artifacts<\/p>\n

Powered by llama.cpp and accessible via the OpenAI API, the built-in inference engine makes running models feel as simple as running a container. On Mac, Model Runner uses host-based execution to tap directly into your hardware \u2014 speeding things up with zero extra effort.<\/p>\n

Models are also packaged as OCI Artifacts, so you can version, store, and ship them using the same trusted registries and CI\/CD workflows you already use. Check out our docs<\/a> for more detailed info!<\/p>\n

Figure 1: Using Docker Model Runner and CLI commands to experiment with models locally<\/strong><\/p>\n

This release lays the groundwork for what\u2019s ahead: support for additional platforms like Windows with GPU, the ability to customize and publish your own models, and deeper integration into the development loop. We\u2019re just getting started with Docker Model Runner and look forward to sharing even more updates and enhancements in the coming weeks.<\/p>\n

Docker AI Agent: Smarter and more powerful with MCP integration + AI Tool Catalog<\/h2>\n

Our vision for the Docker AI Agent is simple: be context-aware, deeply knowledgeable, and available wherever developers build. With this release, we\u2019re one step closer! The Docker AI Agent is now even more capable, making it easier for developers to tap into the Docker ecosystem and streamline their workflows beyond Docker.\u00a0<\/p>\n

Your trusted AI Agent for all things Docker\u00a0<\/h3>\n

The Docker AI agent now has built-in support for many new popular developer capabilities like:<\/p>\n

Running shell commands<\/p>\n

Performing Git operations<\/p>\n

Downloading resources<\/p>\n

Managing local files<\/p>\n

Thanks to a Docker Scout integration, we also now support other tools from the Docker ecosystem, such as performing security analysis on your Dockerfiles or images.\u00a0<\/p>\n

Expanding the Docker AI Agent beyond Docker\u00a0<\/h3>\n

The Docker AI Agent now fully embraces the Model Context Protocol (MCP). This new standard for connecting AI agents and models to external data and tools makes them more powerful and tailored to specific needs. In addition to acting as an MCP client, many of Docker AI Agent\u2019s capabilities are now exposed as MCP Servers. This means you can interact with the agent in Docker Desktop GUI or CLI or your favorite client, such as Claude Desktop and Cursor.<\/p>\n

Figure 2: Extending Docker AI Agent\u2019s capabilities with many tools, including the MCP Catalog.\u00a0<\/strong><\/p>\n

AI Tool Catalog: Your launchpad for experimenting with MCP servers<\/h3>\n

Thanks to the AI Tool Catalog extension in Docker Desktop, you can explore different MCP servers and seamlessly connect the Docker AI agent to other tools or other LLMs to the Docker ecosystem. No more manually configuring multiple MCP servers! We\u2019ve also added secure handling and injection of MPC servers\u2019 secrets, such as API keys, to simplify log-ins and credential management.<\/p>\n

The AI Tool Catalog includes containerized servers that have been pushed to Docker Hub, and we\u2019ll continue to expand them. If you\u2019re working in this space or have an MCP server that you\u2019d like to distribute, please reach out in our public GitHub repo<\/a>. To install the AI Tool Catalog, go to the extensions menu of Docker Desktop or use this<\/a> for installation.<\/p>\n

Figure 3: Explore and discover MCP servers in the AI Tools Catalog extension in Docker Desktop<\/strong><\/p>\n

Bring compliance into focus with Docker Desktop Setting Reporting<\/h2>\n

Building on the Desktop Settings Management capabilities introduced in Docker Desktop 4.36<\/a>, Docker Desktop 4.40 brings robust compliance reporting for Docker Business<\/a> customers. This new powerful feature gives administrators comprehensive visibility into user compliance with assigned settings policies across the organization.<\/p>\n

Key benefits<\/h3>\n

Real-time compliance tracking<\/strong>: Easily monitor which users are compliant with their assigned settings policies. This allows administrators to quickly identify and address non-compliant systems and users.<\/p>\n

Streamlined troubleshooting<\/strong>: Detailed compliance status information helps administrators diagnose why certain users might be non-compliant, reducing resolution time and IT overhead.<\/p>\n

Figure 4: Desktop settings reporting provides an overview of policy assignment and compliance status, helping organizations stay compliant.\u00a0<\/strong><\/p>\n

Get started with Docker Desktop Setting Reporting<\/p>\n

The Desktop Setting Reporting dashboard is currently being rolled out through Early Access. Administrators can see which settings policies are assigned to each user and whether those policies are being correctly applied.<\/p>\n

Soon, administrators will be able to access the reporting dashboard by navigating to the Admin Console > Docker Desktop > Reporting. The dashboard provides a clear view of all users\u2019 compliance status, with options to:<\/p>\n

Search by username or email address<\/p>\n

Filter by assigned policies<\/p>\n

Toggle visibility of compliant users to focus on potential issues<\/p>\n

View detailed compliance information for specific users<\/p>\n

Download comprehensive compliance data as a CSV file<\/p>\n

The dashboard also provides targeted resolution steps for non-compliant users to help administrators quickly address issues and ensure organizational compliance.<\/p>\n

This new reporting capability underscores Docker\u2019s commitment to providing enterprise-grade management tools that simplify administration while maintaining security and compliance across diverse development environments. Learn more about Desktop settings reporting here<\/a>.<\/p>\n

Wrapping up\u00a0<\/h2>\n

Docker is expanding its AI tooling to simplify application development and improve team workflows. New additions like Model Runner, the Docker AI Agent with MCP server and client support, and the AI Tool Catalog extension in Docker Desktop help streamline how developers build with AI. We continue to make enterprise tools more useful and robust, giving admins better visibility into compliance and policy enforcement through Docker Desktop Settings Reporting. We can\u2019t wait to see what you build next!<\/p>\n

Learn more<\/h2>\n

Authenticate and update<\/a> today to receive your subscription level\u2019s newest Docker Desktop features.<\/p>\n

Subscribe to the Docker Navigator Newsletter<\/a>.<\/p>\n

Learn about our sign-in enforcement options<\/a>.<\/p>\n

New to Docker? Create an account<\/a>.\u00a0<\/p>\n

Have questions? The Docker community is here to help<\/a>.<\/p>","protected":false},"excerpt":{"rendered":"

At Docker, we\u2019re focused on making life easier for developers and teams building high-quality applications, including those powered by generative […]<\/p>\n","protected":false},"author":0,"featured_media":0,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","ast-disable-related-posts":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":""},"categories":[4],"tags":[],"class_list":["post-1881","post","type-post","status-publish","format-standard","hentry","category-docker"],"_links":{"self":[{"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/posts\/1881","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/comments?post=1881"}],"version-history":[{"count":0,"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/posts\/1881\/revisions"}],"wp:attachment":[{"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/media?parent=1881"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/categories?post=1881"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/tags?post=1881"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}