{"id":2844,"date":"2025-11-18T18:11:59","date_gmt":"2025-11-18T18:11:59","guid":{"rendered":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/2025\/11\/18\/docker-unsloth-build-custom-models-faster\/"},"modified":"2025-11-18T18:11:59","modified_gmt":"2025-11-18T18:11:59","slug":"docker-unsloth-build-custom-models-faster","status":"publish","type":"post","link":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/2025\/11\/18\/docker-unsloth-build-custom-models-faster\/","title":{"rendered":"Docker + Unsloth: Build Custom Models, Faster"},"content":{"rendered":"<h3 class=\"wp-block-heading\"><strong>Building and Running Custom Models Is Still Hard<\/strong><\/h3>\n\n<p>Running AI models locally is still hard. Even as open-source LLMs grow more capable, <em>actually<\/em> getting them to run on your machine, with the right dependencies, remains slow, fragile, and inconsistent.<\/p>\n\n<p>There\u2019s two sides to this challenge:<\/p>\n<ul class=\"wp-block-list\">\n<li><strong>Model creation and optimization<\/strong>: making fine-tuning and quantization efficient.<\/li>\n<li><strong>Model execution and portability<\/strong>: making models reproducible, isolated, and universal.<\/li>\n<\/ul>\n<p>Solving both lets developers <em>actually use<\/em> the models they build.<\/p>\n\n<h3 class=\"wp-block-heading\"><strong>Docker + Unsloth: Making Iterating on Custom Models Faster<\/strong><\/h3>\n\n<p>A lot of developers want to move away from <em>consume the API<\/em> to <em>own the model.<\/em> They want to fine-tune models for their own use cases but doing it remains hard.<\/p>\n\n<p>We\u2019re excited to be working together with Unsloth to make building, iterating, and running custom LLMs locally faster, simpler, and more accessible for every developer.<\/p>\n\n<p><a href=\"https:\/\/unsloth.ai\/\" rel=\"nofollow noopener\" target=\"_blank\">Unsloth<\/a> lowers the barrier to building (and exporting) fine-tuned custom models. Docker lowers the barrier to running them anywhere.<\/p>\n<p>You can now run any model, including Unsloth Dynamic GGUFs, on Mac, Windows or Linux with Docker Model Runner. Together, friction\u2019s removed between experimentation and execution: dependency and reproducibility gaps.<\/p>\n\n<p>With <a href=\"https:\/\/docs.docker.com\/ai\/model-runner\/\" rel=\"nofollow noopener\" target=\"_blank\"><strong>Docker Model Runner (DMR)<\/strong><\/a>, starting a model is as simple as <code>docker model run<\/code>. For example, running OpenAI\u2019s open-weight model locally becomes incredibly easy:<\/p>\n\n<p><code><strong>docker model run ai\/gpt-oss:20B<\/strong><\/code><\/p>\n\n<h3 class=\"wp-block-heading\"><strong>How It Works<\/strong><\/h3>\n\n<ol class=\"wp-block-list\">\n<li><strong>Fine-tune with Unsloth.<\/strong> Train and optimize your model efficiently.<\/li>\n<li><strong>Export to GGUF.<\/strong> Quantize to a lightweight, portable format for fast local inference.<\/li>\n<li><strong>Run with Docker.<\/strong> Launch instantly with docker model run. No manual setup.<\/li>\n<\/ol>\n<p>Unsloth\u2019s <strong>Dynamic GGUFs<\/strong> help you create compact fine-tuned models. Docker Model Runner lets you spin them up instantly and run them as easily as containers, without worrying about dependency issues. <\/p>\n\n<h3 class=\"wp-block-heading\"><strong>What\u2019s Next<\/strong><\/h3>\n\n<p>Building and running AI should feel as natural as developing and shipping code. Just like containers standardized application deployment, we\u2019re now doing the same for AI.<\/p>\n\n<p><strong>Unsloth + Docker<\/strong> marks one more step in that journey. Learn more in the <a href=\"https:\/\/docs.unsloth.ai\/models\/how-to-run-llms-with-docker\" rel=\"nofollow noopener\" target=\"_blank\">docs<\/a>.\u00a0<\/p>","protected":false},"excerpt":{"rendered":"<p>Building and Running Custom Models Is Still Hard Running AI models locally is still hard. Even as open-source LLMs grow [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":94,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","ast-disable-related-posts":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":""},"categories":[4],"tags":[],"class_list":["post-2844","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-docker"],"_links":{"self":[{"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/posts\/2844","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/comments?post=2844"}],"version-history":[{"count":0,"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/posts\/2844\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/media\/94"}],"wp:attachment":[{"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/media?parent=2844"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/categories?post=2844"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/tags?post=2844"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}