{"id":2619,"date":"2025-10-21T14:11:43","date_gmt":"2025-10-21T14:11:43","guid":{"rendered":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/2025\/10\/21\/introducing-a-richer-docker-model-run-experience\/"},"modified":"2025-10-21T14:11:43","modified_gmt":"2025-10-21T14:11:43","slug":"introducing-a-richer-docker-model-run-experience","status":"publish","type":"post","link":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/2025\/10\/21\/introducing-a-richer-docker-model-run-experience\/","title":{"rendered":"Introducing a Richer \u201ddocker model run\u201d Experience"},"content":{"rendered":"

The command line is where developers live and breathe. A powerful and intuitive CLI can make the difference between a frustrating task and a joyful one. That\u2019s why we\u2019re excited to announce a major upgrade to the interactive chat experience in Docker Model Runner<\/strong>, our tool for running AI workloads locally.<\/p>\n

We\u2019ve rolled out a new, fully-featured interactive prompt for the \u201cdocker model run\u201d command that brings a host of quality-of-life improvements, making it faster, easier, and more intuitive to chat with your local models. Let\u2019s dive into what\u2019s new.<\/p>\n

A True Readline-Style Prompt with Keyboard Shortcuts<\/strong><\/h3>\n

The most significant change is the move to a new readline-like implementation. If you spend any time in a modern terminal, you\u2019ll feel right at home. This brings advanced keyboard support for navigating and editing your prompts right on the command line.<\/p>\n

You can now use familiar keyboard shortcuts to work with your text more efficiently. Here are some of the new key bindings you can start using immediately:<\/p>\n

Move to Start\/End:<\/strong> Use \u201cCtrl + a\u201d to jump to the beginning of the line and \u201cCtrl + e\u201d to jump to the end.<\/p>\n

Word-by-Word Navigation:<\/strong> Quickly move through your prompt using \u201cAlt + b\u201d to go back one word and \u201cAlt + f\u201d to go forward one word.<\/p>\n

Efficient Deletions:<\/strong><\/p>\n

\u201cCtrl + k\u201d: Delete everything from the cursor to the end of the line.<\/p>\n

\u201cCtrl + u\u201d: Delete everything from the cursor to the beginning of the line.<\/p>\n

\u201cCtrl + w\u201d: Delete the word immediately before the cursor.<\/p>\n

Screen and Session Management:<\/strong><\/p>\n

\u201cCtrl + l\u201d: Clear the terminal screen to reduce clutter.<\/p>\n

\u201cCtrl + d\u201d: Exit the chat session, just like the \/bye command.<\/p>\n

Take Back Control with \u201cCtrl + c\u201d<\/strong><\/h3>\n

We\u2019ve all been there: you send a prompt to a model, and it starts generating a long, incorrect, or unwanted response. Previously, you had to wait for it to finish. Not anymore.<\/p>\n

You can now press \u201cCtrl + c\u201d at any time while the model is generating a response to immediately stop it. We\u2019ve implemented this using context cancellation in our client, which sends a signal to halt the streaming response from the model. This gives you full control over the interaction, saving you time and frustration. This feature has also been added to the basic interactive mode for users who may not be in a standard terminal environment. \u201cCtrl + c\u201d ends that interaction but does not exit. \u201cCtrl + d\u201d exits \u201cdocker model run\u201d.<\/p>\n

Improved Multi-line and History Support<\/strong><\/h3>\n

Working with multi-line prompts, like pasting in code snippets, is now much smoother. The prompt intelligently changes from > to a more subtle . to indicate that you\u2019re in multi-line mode.<\/p>\n

Furthermore, the new prompt includes command history. Simply use the Up and Down arrow keys to cycle through your previous prompts, making it easy to experiment, correct mistakes, or ask follow-up questions without retyping everything. For privacy or scripting purposes, you can disable history writing by setting the DOCKER_MODEL_NOHISTORY environment variable.<\/p>\n

<\/div>\n

Get Started Today!<\/strong><\/h3>\n

These improvements make \u201cdocker model run\u201d a more powerful and pleasant tool for all your local AI experiments. Pull a model from Docker Hub and start a chat to experience the new prompt yourself:<\/p>\n

\n$ docker model run ai\/gemma3
\n> Tell me a joke about docker containers.
\nWhy did the Docker container break up with the Linux host?\n

… Because it said, “I need some space!” <\/p>\n

—<\/p>\n

Would you like to hear another one?
\n><\/p>\n<\/div>\n

Help Us Build the Future of Local AI<\/strong><\/h3>\n

Docker Model Runner is an open-source project, and we\u2019re building it for the community. These updates are a direct result of our effort to create the best possible experience for developers working with AI.<\/p>\n

We invite you to get involved!<\/p>\n

Star, fork, and contribute<\/strong> to the project on GitHub: https:\/\/github.com\/docker\/model-runner<\/a><\/p>\n

Report issues<\/strong> and suggest new features you\u2019d like to see.<\/p>\n

Share your feedback<\/strong> with us and the community.<\/p>\n

Your contributions help shape the future of local AI development and make powerful tools accessible to everyone. We can\u2019t wait to see what you build!<\/p>\n

Learn more<\/strong><\/h3>\n

Check out the Docker Model Runner General Availability announcement<\/a><\/p>\n

Visit our Model Runner GitHub repo<\/a>! Docker Model Runner is open-source, and we welcome collaboration and contributions from the community!<\/p>\n

Get started with Docker Model Runner with a simple hello GenAI application<\/a><\/p>","protected":false},"excerpt":{"rendered":"

The command line is where developers live and breathe. A powerful and intuitive CLI can make the difference between a […]<\/p>\n","protected":false},"author":0,"featured_media":0,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","ast-disable-related-posts":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":""},"categories":[4],"tags":[],"class_list":["post-2619","post","type-post","status-publish","format-standard","hentry","category-docker"],"_links":{"self":[{"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/posts\/2619","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/comments?post=2619"}],"version-history":[{"count":0,"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/posts\/2619\/revisions"}],"wp:attachment":[{"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/media?parent=2619"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/categories?post=2619"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/tags?post=2619"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}