<script data-pm-proxy="intercept"></script><?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:itunes="http://www.itunes.com/dtds/podcast-1.0.dtd" xmlns:googleplay="http://www.google.com/schemas/play-podcasts/1.0"><channel><title><![CDATA[Unsloth AI]]></title><description><![CDATA[Welcome to Unsloth's newsletter where we'll be sharing tips & tricks on AI, our latest releases and more! 🦥]]></description><link>https://unslothai.substack.com</link><image><url>https://substackcdn.com/image/fetch/$s_!RnCx!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F661b5748-cc92-4e9b-86dd-450d18a35897_600x600.png</url><title>Unsloth AI</title><link>https://unslothai.substack.com</link></image><generator>Substack</generator><lastBuildDate>Fri, 04 Sep 2026 13:55:49 GMT</lastBuildDate><atom:link href="/__u/unslothai.substack.com/feed" rel="self" type="application/rss+xml"/><copyright><![CDATA[Unsloth AI]]></copyright><language><![CDATA[en]]></language><webMaster><![CDATA[info@unsloth.ai]]></webMaster><itunes:owner><itunes:email><![CDATA[info@unsloth.ai]]></itunes:email><itunes:name><![CDATA[Unsloth AI]]></itunes:name></itunes:owner><itunes:author><![CDATA[Unsloth AI]]></itunes:author><googleplay:owner><![CDATA[info@unsloth.ai]]></googleplay:owner><googleplay:email><![CDATA[info@unsloth.ai]]></googleplay:email><googleplay:author><![CDATA[Unsloth AI]]></googleplay:author><itunes:block><![CDATA[Yes]]></itunes:block><item><title><![CDATA[Introducing Unsloth Desktop 🦥]]></title><description><![CDATA[The first desktop app to run and train models locally]]></description><link>https://unslothai.substack.com/p/introducing-unsloth-desktop</link><guid isPermaLink="false">https://unslothai.substack.com/p/introducing-unsloth-desktop</guid><dc:creator><![CDATA[Unsloth AI]]></dc:creator><pubDate>Tue, 11 Aug 2026 18:34:53 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!PaES!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2dd6186e-ba88-4fa2-9130-5135e18ebbe3_2560x1600.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Today, we&#8217;re excited to launch <strong>Unsloth Desktop</strong>, our new open-source desktop app <span>for running and training models locally on </span><strong>Windows</strong><span>, </span><strong>macOS</strong><span> and </span><strong>Linux</strong><span>.</span></p><p><span>Unsloth Desktop is easy to download and requires no setup. It&#8217;s available for nearly all modern CPU and GPU setups and most operating systems.</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!PaES!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2dd6186e-ba88-4fa2-9130-5135e18ebbe3_2560x1600.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!PaES!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2dd6186e-ba88-4fa2-9130-5135e18ebbe3_2560x1600.png 424w, /__u/substackcdn.com/image/fetch/$s_!PaES!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2dd6186e-ba88-4fa2-9130-5135e18ebbe3_2560x1600.png 848w, /__u/substackcdn.com/image/fetch/$s_!PaES!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2dd6186e-ba88-4fa2-9130-5135e18ebbe3_2560x1600.png 1272w, /__u/substackcdn.com/image/fetch/$s_!PaES!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2dd6186e-ba88-4fa2-9130-5135e18ebbe3_2560x1600.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!PaES!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2dd6186e-ba88-4fa2-9130-5135e18ebbe3_2560x1600.png" width="1456" height="910" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/2dd6186e-ba88-4fa2-9130-5135e18ebbe3_2560x1600.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:910,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:422095,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://unslothai.substack.com/i/210756493?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2dd6186e-ba88-4fa2-9130-5135e18ebbe3_2560x1600.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!PaES!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2dd6186e-ba88-4fa2-9130-5135e18ebbe3_2560x1600.png 424w, /__u/substackcdn.com/image/fetch/$s_!PaES!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2dd6186e-ba88-4fa2-9130-5135e18ebbe3_2560x1600.png 848w, /__u/substackcdn.com/image/fetch/$s_!PaES!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2dd6186e-ba88-4fa2-9130-5135e18ebbe3_2560x1600.png 1272w, /__u/substackcdn.com/image/fetch/$s_!PaES!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2dd6186e-ba88-4fa2-9130-5135e18ebbe3_2560x1600.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://unsloth.ai/docs/desktop&quot;,&quot;text&quot;:&quot;Read Unsloth Desktop Blog&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="https://unsloth.ai/docs/desktop"><span>Read Unsloth Desktop Blog</span></a></p><p>Here is an overview of everything Unsloth supports:</p><ul><li><p>Supports text, MLX, <strong>diffusion image/video</strong>, audio, GGUF and more models</p></li><li><p><strong>Self-healing tool calls</strong><span> are 50% more accurate, with sandboxed Python and Bash execution</span></p></li><li><p><strong>Image and video generation + training</strong><span>, with faster diffusion inference</span></p></li><li><p><span>Day-zero support for </span><strong><span>Qwen3.8</span></strong><span>, </span><strong>Muse Glimmer 30B</strong><span>, MiniMax H3, Kimi K3, DeepSeek-V4 Flash and Gemma 4</span></p></li><li><p><span>Unlimited private </span><strong>web search, Deep Research, RAG and MCP</strong></p></li><li><p><strong>Parallel chats</strong><span>, each with its own tools, sandbox and prompt queue</span></p></li><li><p><span>An </span><strong>OpenAI-compatible API</strong><span>, plus connections to cloud OpenAI and Anthropic models</span></p></li><li><p><span>Secure remote access from any device via </span><strong>Cloudflare HTTPS</strong></p></li><li><p><span>Runs on </span>NVIDIA, AMD, Intel, Apple Silicon, CPU and multi-GPU<span> systems</span></p></li></ul><h3><span>Image + video generation &#127916;</span></h3><p><span>You can now generate and train </span><strong>images and videos locally</strong><span>, right inside Desktop. Diffusion is inference faster, LoRA workflows are supported, and video generation works on </span><strong>Apple Silicon</strong><span> through Metal and via CPU setups.</span></p><p><strong>MiniMax H3</strong><span> is supported and it generates video with synchronized audio, and takes images, videos or audio as references. On an NVIDIA B200, a 960&#215;544, 124-frame, 8-step generation dropped from 70+ seconds to around </span><strong>13 seconds</strong><span>.</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!DyxG!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fad41e185-d7e8-47bc-b289-7d8edca13676_2704x1514.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!DyxG!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fad41e185-d7e8-47bc-b289-7d8edca13676_2704x1514.png 424w, /__u/substackcdn.com/image/fetch/$s_!DyxG!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fad41e185-d7e8-47bc-b289-7d8edca13676_2704x1514.png 848w, /__u/substackcdn.com/image/fetch/$s_!DyxG!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fad41e185-d7e8-47bc-b289-7d8edca13676_2704x1514.png 1272w, /__u/substackcdn.com/image/fetch/$s_!DyxG!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fad41e185-d7e8-47bc-b289-7d8edca13676_2704x1514.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!DyxG!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fad41e185-d7e8-47bc-b289-7d8edca13676_2704x1514.png" width="1456" height="815" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/ad41e185-d7e8-47bc-b289-7d8edca13676_2704x1514.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:815,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1754447,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://unslothai.substack.com/i/210756493?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fad41e185-d7e8-47bc-b289-7d8edca13676_2704x1514.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!DyxG!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fad41e185-d7e8-47bc-b289-7d8edca13676_2704x1514.png 424w, /__u/substackcdn.com/image/fetch/$s_!DyxG!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fad41e185-d7e8-47bc-b289-7d8edca13676_2704x1514.png 848w, /__u/substackcdn.com/image/fetch/$s_!DyxG!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fad41e185-d7e8-47bc-b289-7d8edca13676_2704x1514.png 1272w, /__u/substackcdn.com/image/fetch/$s_!DyxG!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fad41e185-d7e8-47bc-b289-7d8edca13676_2704x1514.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h3><span> Better tool calling &#128295;</span></h3><p><span>Tool calling is now </span><strong>50% more accurate</strong><span> with self-healing tool calls. Your local models can run Python and Bash in a sandbox to calculate, analyze data, test code and generate files, and malformed tool calls get repaired and retried automatically. You can download any files or artifacts your chats produce.</span></p><p><span>You can also connect your local model to most agents. Run:</span></p><pre><code><span>unsloth start claude</span></code></pre><p><span>to connect your local model with Claude Code. You can switch between Claude Code, Codex, and other agents interchangeably.</span></p><h3><span>Deep Research + Local RAG &#128270;</span></h3><p><span>Desktop includes unlimited private </span><strong>web search, deep research, RAG </strong>and<strong> MCP</strong><span>. Deep Research builds a plan, reads sources, tracks citations and produces a full report, and you can combine it with your own knowledge bases.</span></p><p><span>You can also </span><strong>link a local folder directly to RAG</strong><span> and it stays synced. Add, rename or update files and Unsloth handles it.</span></p><p><span>You can also start a new conversation while another model is still generating and do parallel chats.</span></p><h3><span>Meta Muse Glimmer 30B</span></h3><p><span>Today&#8217;s also comes with support for Meta&#8217;s new dense 30B coding model &#8216;Muse Glimmer&#8217; which runs locally on around </span><strong>18GB RAM/VRAM </strong>setups<span>, and you can fine-tune the model with Unsloth.</span></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://unsloth.ai/docs/models/muse-glimmer&quot;,&quot;text&quot;:&quot;Meta Muse Glimmer&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://unsloth.ai/docs/models/muse-glimmer"><span>Meta Muse Glimmer</span></a></p><h3><span>Run Local Models Anywhere &#128187;</span></h3><p><span>Unsloth Desktop works on </span>NVIDIA, AMD, Intel/Vulkan, Apple Silicon, CPU and multi-GPU<span> systems, with GPU layer controls, memory offloading and tensor parallelism for GGUF models. You can serve anything through the OpenAI-compatible API, expose it securely over Cloudflare HTTPS, and essentially access the model remotely via a phone or another device.</span></p><h3><span>Unsloth Desktop GitHub</span></h3><p><span>Unsloth Desktop is available now for </span><strong>Windows</strong><span>, </span><strong>macOS</strong><span> and </span><strong>Linux</strong><span>.</span></p><p>You can also download Unsloth Desktop from our GitHub releases page. We&#8217;d love for you to try it out and are more than happy for any feedback!</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://github.com/unslothai/unsloth&quot;,&quot;text&quot;:&quot;Star us on GitHub&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://github.com/unslothai/unsloth"><span>Star us on GitHub</span></a></p><p>A huge thanks to NVIDIA and Hugging Face for collaborating with us on this release! And most importantly, we&#8217;re grateful for our early alpha testers and couldn&#8217;t have done it without them.</p><p>We hope to share more exciting news soon, especially around Qwen3.8.</p>]]></content:encoded></item><item><title><![CDATA[Unsloth x AMD]]></title><description><![CDATA[Hey there!]]></description><link>https://unslothai.substack.com/p/unsloth-for-amd-is-here</link><guid isPermaLink="false">https://unslothai.substack.com/p/unsloth-for-amd-is-here</guid><dc:creator><![CDATA[Unsloth AI]]></dc:creator><pubDate>Mon, 20 Jul 2026 15:50:25 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!WFyG!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f2cffd7-eda7-4ca6-9fcf-d8a20d9c2a1e_2560x900.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><span>Hey there! It&#8217;s been a while since our last newsletter and we have a lot of updates. We&#8217;ve added AMD training support and completely reimagined Unsloth Studio, introducing a new Hub, expanded customization, more language support, many new features, models, and much more.</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!WFyG!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f2cffd7-eda7-4ca6-9fcf-d8a20d9c2a1e_2560x900.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!WFyG!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f2cffd7-eda7-4ca6-9fcf-d8a20d9c2a1e_2560x900.png 424w, /__u/substackcdn.com/image/fetch/$s_!WFyG!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f2cffd7-eda7-4ca6-9fcf-d8a20d9c2a1e_2560x900.png 848w, /__u/substackcdn.com/image/fetch/$s_!WFyG!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f2cffd7-eda7-4ca6-9fcf-d8a20d9c2a1e_2560x900.png 1272w, /__u/substackcdn.com/image/fetch/$s_!WFyG!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f2cffd7-eda7-4ca6-9fcf-d8a20d9c2a1e_2560x900.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!WFyG!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f2cffd7-eda7-4ca6-9fcf-d8a20d9c2a1e_2560x900.png" width="1456" height="512" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/4f2cffd7-eda7-4ca6-9fcf-d8a20d9c2a1e_2560x900.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:512,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:425812,&quot;alt&quot;:&quot;Unsloth Mascot on AMD GPU&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://unslothai.substack.com/i/207758959?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f2cffd7-eda7-4ca6-9fcf-d8a20d9c2a1e_2560x900.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Unsloth Mascot on AMD GPU" title="Unsloth Mascot on AMD GPU" srcset="/__u/substackcdn.com/image/fetch/$s_!WFyG!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f2cffd7-eda7-4ca6-9fcf-d8a20d9c2a1e_2560x900.png 424w, /__u/substackcdn.com/image/fetch/$s_!WFyG!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f2cffd7-eda7-4ca6-9fcf-d8a20d9c2a1e_2560x900.png 848w, /__u/substackcdn.com/image/fetch/$s_!WFyG!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f2cffd7-eda7-4ca6-9fcf-d8a20d9c2a1e_2560x900.png 1272w, /__u/substackcdn.com/image/fetch/$s_!WFyG!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f2cffd7-eda7-4ca6-9fcf-d8a20d9c2a1e_2560x900.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h3><span>&#128154; Unsloth x AMD</span></h3><p><span>We collaborated with AMD to enable you to train and run LLMs locally on AMD GPUs across 500+ models. </span>Works on AMD Radeon, Instinct, Ryzen and data center GPUs across Windows, WSL, and Linux. You can train models 2&#215; faster with 70% less VRAM and no accuracy loss on just 3GB VRAM. We also have optimized ROCm builds for GGUF and Safetensors inference. <a href="https://github.com/unslothai/unsloth">GitHub repo</a></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://unsloth.ai/docs/basics/amd&quot;,&quot;text&quot;:&quot;AMD Blog&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://unsloth.ai/docs/basics/amd"><span>AMD Blog</span></a></p><h3><span>&#129517; New Model Hub</span></h3><p><span>We&#8217;re introducing a new Model Hub which makes it easier to discover, download and run models, with a trending feed, search, README previews and a resumable download manager. We also rebuilt model context auto-fitting, delivering </span><strong>up to ~3&#215; longer context</strong><span> in several scenarios.</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!SzGd!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb0cc3ee2-9bdd-43f0-924d-f19d87f53a75_2018x1066.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!SzGd!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb0cc3ee2-9bdd-43f0-924d-f19d87f53a75_2018x1066.png 424w, /__u/substackcdn.com/image/fetch/$s_!SzGd!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb0cc3ee2-9bdd-43f0-924d-f19d87f53a75_2018x1066.png 848w, /__u/substackcdn.com/image/fetch/$s_!SzGd!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb0cc3ee2-9bdd-43f0-924d-f19d87f53a75_2018x1066.png 1272w, /__u/substackcdn.com/image/fetch/$s_!SzGd!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb0cc3ee2-9bdd-43f0-924d-f19d87f53a75_2018x1066.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!SzGd!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb0cc3ee2-9bdd-43f0-924d-f19d87f53a75_2018x1066.png" width="728" height="384.5" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b0cc3ee2-9bdd-43f0-924d-f19d87f53a75_2018x1066.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:false,&quot;imageSize&quot;:&quot;normal&quot;,&quot;height&quot;:769,&quot;width&quot;:1456,&quot;resizeWidth&quot;:728,&quot;bytes&quot;:394985,&quot;alt&quot;:&quot;Unsloth Studio new model hub&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://unslothai.substack.com/i/207758959?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb0cc3ee2-9bdd-43f0-924d-f19d87f53a75_2018x1066.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:&quot;center&quot;,&quot;offset&quot;:false}" class="sizing-normal" alt="Unsloth Studio new model hub" title="Unsloth Studio new model hub" srcset="/__u/substackcdn.com/image/fetch/$s_!SzGd!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb0cc3ee2-9bdd-43f0-924d-f19d87f53a75_2018x1066.png 424w, /__u/substackcdn.com/image/fetch/$s_!SzGd!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb0cc3ee2-9bdd-43f0-924d-f19d87f53a75_2018x1066.png 848w, /__u/substackcdn.com/image/fetch/$s_!SzGd!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb0cc3ee2-9bdd-43f0-924d-f19d87f53a75_2018x1066.png 1272w, /__u/substackcdn.com/image/fetch/$s_!SzGd!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb0cc3ee2-9bdd-43f0-924d-f19d87f53a75_2018x1066.png 1456w" sizes="100vw"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h3><span>&#9889; Dynamic NVFP4 quants + Better export</span></h3><p><span>We&#8217;ve released new </span>Dynamic NVFP4 quants for <strong>NVIDIA Blackwell GPUs</strong><span>, covering Qwen3.6 and Gemma 4. They enable faster and more accurate 4-bit inference. Unsloth can now also create merged FP8 and NVFP4 exports after training, plus imatrix-assisted GGUF quantization.</span></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://unsloth.ai/docs/basics/nvfp4&quot;,&quot;text&quot;:&quot;Dynamic NVFP4 Blog&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://unsloth.ai/docs/basics/nvfp4"><span>Dynamic NVFP4 Blog</span></a></p><h3><span>&#128142; Gemma 4 improvements</span></h3><p><span>The full Gemma 4, QAT family now runs and trains in Unsloth, including the new 12B model alongside E2B, E4B, 26B-A4B and 31B. We also uploaded new Dynamic NVFP4 quants. Recently, Google also added better tool calling and </span><strong>MTP</strong><span> for faster and improved local inference.</span></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://unsloth.ai/docs/models/gemma-4&quot;,&quot;text&quot;:&quot;Gemma 4 Blog&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://unsloth.ai/docs/models/gemma-4"><span>Gemma 4 Blog</span></a></p><h3>&#127912; Make Unsloth yours</h3><p>Unsloth Studio&#8217;s appearance is now fully customizable, palettes, custom accent/background colors, fonts and accessibility settings, all synced across devices. We also now support 12 languages including Japanese, Chinese, Portuguese, Hindu, Arabic and others. Local transcription is also coming this week!</p><h3><span>&#128051; Better model and GPU control</span></h3><p><span>We now have much more customization for model loading. Loading now exposes Flash Attention and tensor-parallel options. A new GPU Memory panel lets you choose which GPUs to use, set GPU layers and control MoE expert offload, or leave everything to Unsloth&#8217;s automatic fit mode.</span></p><h3><span>&#128302; New models</span></h3><ul><li><p><strong><a href="https://unsloth.ai/docs/models/deepseek-v4">DeepSeek-V4-Flash</a>, <a href="https://unsloth.ai/docs/models/glm-5.2">GLM-5.2</a>, <a href="https://unsloth.ai/docs/models/qwen3.6">Qwen3.6</a></strong> <span> - run the new agentic models</span></p></li><li><p><strong><a href="https://unsloth.ai/docs/models/inkling">Inkling</a></strong>, <strong><a href="https://unsloth.ai/docs/models/diffusiongemma">DiffusionGemma,</a> <a href="https://huggingface.co/unsloth/Qwen-AgentWorld-35B-A3B-GGUF">Qwen-AgentWorld</a></strong>, <strong><a href="https://huggingface.co/unsloth/Ornith-1.0-35B-GGUF">Ornith</a>, <a href="https://unsloth.ai/docs/models/kimi-k2.7-code">Kimi K2.7 Code</a></strong><span> and </span><strong><a href="https://unsloth.ai/docs/models/minimax-m3">MiniMax-M3</a></strong><span> - are all now available and supported in Unsloth.</span></p></li></ul><p><span>Hope you have a lovely rest of July! We&#8217;ve got even more hardware, Unsloth and model updates on the way. &#129445;</span></p>]]></content:encoded></item><item><title><![CDATA[Google Gemma 4 now in Unsloth]]></title><description><![CDATA[Google DeepMind releases Gemma 4 today, a new family of open models, including E2B, E4B, 26B-A4B, and 31B. You can now run and fine-tune them in Unsloth.]]></description><link>https://unslothai.substack.com/p/google-gemma-4-now-in-unsloth</link><guid isPermaLink="false">https://unslothai.substack.com/p/google-gemma-4-now-in-unsloth</guid><dc:creator><![CDATA[Unsloth AI]]></dc:creator><pubDate>Thu, 02 Apr 2026 20:00:18 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/7adf6249-2797-4596-bee3-94a2007057c2_1200x630.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Google DeepMind releases Gemma 4 today, a new family of open models, including <strong>E2B</strong>,<strong> E4B</strong>,<strong> 26B-A4B</strong>, and <strong>31B.</strong> These multimodal, hybrid-thinking models support 140+ languages, up to <strong>256K context</strong>, and come in both dense and MoE variants. Gemma 4 can now run locally and be fine-tuned in <a href="https://unsloth.ai/docs/models/gemma-4#unsloth-studio-guide">Unsloth Studio</a>.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!re5E!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1ff9d98-c8bc-4597-8cd0-c9c7f702a60f_2560x900.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!re5E!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1ff9d98-c8bc-4597-8cd0-c9c7f702a60f_2560x900.png 424w, /__u/substackcdn.com/image/fetch/$s_!re5E!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1ff9d98-c8bc-4597-8cd0-c9c7f702a60f_2560x900.png 848w, /__u/substackcdn.com/image/fetch/$s_!re5E!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1ff9d98-c8bc-4597-8cd0-c9c7f702a60f_2560x900.png 1272w, /__u/substackcdn.com/image/fetch/$s_!re5E!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1ff9d98-c8bc-4597-8cd0-c9c7f702a60f_2560x900.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!re5E!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1ff9d98-c8bc-4597-8cd0-c9c7f702a60f_2560x900.png" width="1456" height="512" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/f1ff9d98-c8bc-4597-8cd0-c9c7f702a60f_2560x900.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:512,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:448411,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://unslothai.substack.com/i/192980363?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1ff9d98-c8bc-4597-8cd0-c9c7f702a60f_2560x900.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!re5E!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1ff9d98-c8bc-4597-8cd0-c9c7f702a60f_2560x900.png 424w, /__u/substackcdn.com/image/fetch/$s_!re5E!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1ff9d98-c8bc-4597-8cd0-c9c7f702a60f_2560x900.png 848w, /__u/substackcdn.com/image/fetch/$s_!re5E!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1ff9d98-c8bc-4597-8cd0-c9c7f702a60f_2560x900.png 1272w, /__u/substackcdn.com/image/fetch/$s_!re5E!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1ff9d98-c8bc-4597-8cd0-c9c7f702a60f_2560x900.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Thank you Google for providing Unsloth with day zero access. For more details on Gemma 4 and usage, read our blog / guide:</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://unsloth.ai/docs/models/gemma-4&quot;,&quot;text&quot;:&quot;Gemma 4 Blog&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://unsloth.ai/docs/models/gemma-4"><span>Gemma 4 Blog</span></a></p><div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;c99ac19f-e727-4a67-8071-b914019aae8b&quot;,&quot;duration&quot;:null}"></div><h3>&#10024; Unsloth Updates</h3><p>Since we released <a href="https://unsloth.ai/docs/new/studio">Unsloth Studio</a> 2 weeks ago, we&#8217;ve made many improvements. Most notably:</p><ul><li><p><strong>50-80% more accurate Tool calling</strong>: better parsing, better accuracy, faster execution, no raw tool markup in chat, plus a new Tool Outputs panel and timers.</p></li><li><p>Pre-compiled <code>llama.cpp</code> binaries for ~1min installs and -50% less size</p></li><li><p><strong>Auto-detection of existing models</strong> / GGUFs</p></li><li><p><strong>20&#8211;30% faster inference</strong>, now matches <code>llama-server</code> / <code>llama.cpp</code> speeds.</p></li><li><p>New <strong>Desktop app shortcuts</strong></p></li><li><p><strong>Data Recipes</strong> now supports <strong>macOS, CPU</strong> and multi-file uploads.</p></li></ul><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://unsloth.ai/docs/new/studio&quot;,&quot;text&quot;:&quot;Unsloth Studio&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://unsloth.ai/docs/new/studio"><span>Unsloth Studio</span></a></p><p>Unsloth Studio now also installs in one command:</p><p><strong>macOS, Linux, WSL:</strong></p><pre><code>curl -fsSL https://unsloth.ai/install.sh | sh</code></pre><p><strong>Windows:</strong></p><pre><code><code>irm https://unsloth.ai/install.ps1 | iex</code></code></pre><p>A new way to use Unsloth is also coming soon&#8230;</p>]]></content:encoded></item><item><title><![CDATA[Introducing Unsloth Studio ✨]]></title><description><![CDATA[Today, we&#8217;re excited to launch Unsloth Studio (Beta): an open-source, no-code web UI for training, running and exporting open models in one unified local interface.]]></description><link>https://unslothai.substack.com/p/introducing-unsloth-studio</link><guid isPermaLink="false">https://unslothai.substack.com/p/introducing-unsloth-studio</guid><dc:creator><![CDATA[Unsloth AI]]></dc:creator><pubDate>Tue, 17 Mar 2026 18:53:46 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!PVIN!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F17bbd52c-9f5e-4c29-ba5d-ed0b9a4eadaf_2437x1325.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Today, we&#8217;re excited to launch <strong>Unsloth Studio </strong>(Beta): an open-source, no-code web UI for training, running and exporting open models in one unified <strong>local</strong> interface.</p><ul><li><p><strong>Run GGUF</strong> and safetensor models locally on <strong>Mac</strong>, Windows, Linux.</p></li><li><p>Train 500+ models 2x faster with 70% less VRAM (no accuracy loss)</p></li><li><p>Run and train text, vision, TTS audio, embedding models</p></li></ul><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://unsloth.ai/docs/new/studio&quot;,&quot;text&quot;:&quot;Read Unsloth Studio Blog&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://unsloth.ai/docs/new/studio"><span>Read Unsloth Studio Blog</span></a></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!PVIN!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F17bbd52c-9f5e-4c29-ba5d-ed0b9a4eadaf_2437x1325.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!PVIN!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F17bbd52c-9f5e-4c29-ba5d-ed0b9a4eadaf_2437x1325.png 424w, /__u/substackcdn.com/image/fetch/$s_!PVIN!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F17bbd52c-9f5e-4c29-ba5d-ed0b9a4eadaf_2437x1325.png 848w, /__u/substackcdn.com/image/fetch/$s_!PVIN!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F17bbd52c-9f5e-4c29-ba5d-ed0b9a4eadaf_2437x1325.png 1272w, /__u/substackcdn.com/image/fetch/$s_!PVIN!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F17bbd52c-9f5e-4c29-ba5d-ed0b9a4eadaf_2437x1325.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!PVIN!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F17bbd52c-9f5e-4c29-ba5d-ed0b9a4eadaf_2437x1325.png" width="1456" height="792" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/17bbd52c-9f5e-4c29-ba5d-ed0b9a4eadaf_2437x1325.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:792,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:624066,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://unslothai.substack.com/i/191285465?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F17bbd52c-9f5e-4c29-ba5d-ed0b9a4eadaf_2437x1325.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!PVIN!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F17bbd52c-9f5e-4c29-ba5d-ed0b9a4eadaf_2437x1325.png 424w, /__u/substackcdn.com/image/fetch/$s_!PVIN!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F17bbd52c-9f5e-4c29-ba5d-ed0b9a4eadaf_2437x1325.png 848w, /__u/substackcdn.com/image/fetch/$s_!PVIN!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F17bbd52c-9f5e-4c29-ba5d-ed0b9a4eadaf_2437x1325.png 1272w, /__u/substackcdn.com/image/fetch/$s_!PVIN!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F17bbd52c-9f5e-4c29-ba5d-ed0b9a4eadaf_2437x1325.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><ul><li><p><strong>MacOS </strong>and<strong> CPU </strong>work for <a href="https://app.gitbook.com/o/HpyELzcNe0topgVLGCZY/s/xhOjnexMCB3dmuQFQ2Zq/new/studio#run-models-locally">Chat</a> GGUF inference. MLX training coming soon.</p></li><li><p>&#8203;Export your model to GGUF, 16-bit safetensor etc.</p></li><li><p>&#8203;Auto inference parameter tuning and edit chat templates.</p></li></ul><p>Unsloth Studio allows &#8203;<strong>Self-healing tool calling</strong> / web search + <strong>code execution</strong>&#8203;. LLMs can run code and programs in a sandbox so it can calculate, analyze data, test code, generate files, or verify an answer with actual computation. This makes answers from models more reliable and accurate.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!UQiT!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd0580e71-e773-493a-941a-77134c1f8c9c_1920x1080.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!UQiT!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd0580e71-e773-493a-941a-77134c1f8c9c_1920x1080.png 424w, /__u/substackcdn.com/image/fetch/$s_!UQiT!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd0580e71-e773-493a-941a-77134c1f8c9c_1920x1080.png 848w, /__u/substackcdn.com/image/fetch/$s_!UQiT!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd0580e71-e773-493a-941a-77134c1f8c9c_1920x1080.png 1272w, /__u/substackcdn.com/image/fetch/$s_!UQiT!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd0580e71-e773-493a-941a-77134c1f8c9c_1920x1080.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!UQiT!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd0580e71-e773-493a-941a-77134c1f8c9c_1920x1080.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d0580e71-e773-493a-941a-77134c1f8c9c_1920x1080.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:277429,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://unslothai.substack.com/i/191285465?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd0580e71-e773-493a-941a-77134c1f8c9c_1920x1080.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!UQiT!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd0580e71-e773-493a-941a-77134c1f8c9c_1920x1080.png 424w, /__u/substackcdn.com/image/fetch/$s_!UQiT!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd0580e71-e773-493a-941a-77134c1f8c9c_1920x1080.png 848w, /__u/substackcdn.com/image/fetch/$s_!UQiT!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd0580e71-e773-493a-941a-77134c1f8c9c_1920x1080.png 1272w, /__u/substackcdn.com/image/fetch/$s_!UQiT!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd0580e71-e773-493a-941a-77134c1f8c9c_1920x1080.png 1456w" sizes="100vw"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>No dataset needed. Transform PDFs, CSV, DOCX, TXT or any file into a structured synthetic datasets via Unsloth Data Recipes. Build and edit your datasets visually via a graph-node workflow and use them for fine-tuning.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!0brR!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd0f1cf91-c1a7-4f4c-99f6-9e3be289c139_2195x1348.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!0brR!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd0f1cf91-c1a7-4f4c-99f6-9e3be289c139_2195x1348.png 424w, /__u/substackcdn.com/image/fetch/$s_!0brR!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd0f1cf91-c1a7-4f4c-99f6-9e3be289c139_2195x1348.png 848w, /__u/substackcdn.com/image/fetch/$s_!0brR!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd0f1cf91-c1a7-4f4c-99f6-9e3be289c139_2195x1348.png 1272w, /__u/substackcdn.com/image/fetch/$s_!0brR!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd0f1cf91-c1a7-4f4c-99f6-9e3be289c139_2195x1348.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!0brR!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd0f1cf91-c1a7-4f4c-99f6-9e3be289c139_2195x1348.png" width="1456" height="894" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d0f1cf91-c1a7-4f4c-99f6-9e3be289c139_2195x1348.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:894,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:670444,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://unslothai.substack.com/i/191285465?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd0f1cf91-c1a7-4f4c-99f6-9e3be289c139_2195x1348.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!0brR!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd0f1cf91-c1a7-4f4c-99f6-9e3be289c139_2195x1348.png 424w, /__u/substackcdn.com/image/fetch/$s_!0brR!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd0f1cf91-c1a7-4f4c-99f6-9e3be289c139_2195x1348.png 848w, /__u/substackcdn.com/image/fetch/$s_!0brR!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd0f1cf91-c1a7-4f4c-99f6-9e3be289c139_2195x1348.png 1272w, /__u/substackcdn.com/image/fetch/$s_!0brR!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd0f1cf91-c1a7-4f4c-99f6-9e3be289c139_2195x1348.png 1456w" sizes="100vw"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Unsloth Studio provides the complete workflow, from data preparation and training to observability, inference, export, and deployment. You can now use Unsloth Studio locally via GitHub:</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://github.com/unslothai/unsloth&quot;,&quot;text&quot;:&quot;&#11088; Star us on GitHub&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://github.com/unslothai/unsloth"><span>&#11088; Star us on GitHub</span></a></p><p>Thank you so much for the support as always. Thank you to NVIDIA and Hugging Face for being great partners. We hope to release multiGPU and Apple Silicon MLX training very soon!</p>]]></content:encoded></item><item><title><![CDATA[Unsloth 2026 Update - Faster MoE]]></title><description><![CDATA[Welcome to our first release of 2026.]]></description><link>https://unslothai.substack.com/p/unsloth-2026-update-faster-moe</link><guid isPermaLink="false">https://unslothai.substack.com/p/unsloth-2026-update-faster-moe</guid><dc:creator><![CDATA[Unsloth AI]]></dc:creator><pubDate>Tue, 10 Feb 2026 15:31:27 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!M62D!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6e32da8c-ef67-4a57-b18f-0d6c32769946_2560x1020.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Welcome to our first release of 2026. To kick things off, we&#8217;re introducing 12x faster MoE training, embedding model support, and ultra long context for Reinforcement Learning. We&#8217;ll also be launching our brand new UI soon!</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://unsloth.ai/docs" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!M62D!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6e32da8c-ef67-4a57-b18f-0d6c32769946_2560x1020.png 424w, /__u/substackcdn.com/image/fetch/$s_!M62D!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6e32da8c-ef67-4a57-b18f-0d6c32769946_2560x1020.png 848w, /__u/substackcdn.com/image/fetch/$s_!M62D!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6e32da8c-ef67-4a57-b18f-0d6c32769946_2560x1020.png 1272w, /__u/substackcdn.com/image/fetch/$s_!M62D!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6e32da8c-ef67-4a57-b18f-0d6c32769946_2560x1020.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!M62D!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6e32da8c-ef67-4a57-b18f-0d6c32769946_2560x1020.png" width="1456" height="580" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/6e32da8c-ef67-4a57-b18f-0d6c32769946_2560x1020.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:580,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:843737,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:&quot;https://unsloth.ai/docs&quot;,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://unslothai.substack.com/i/186716340?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6e32da8c-ef67-4a57-b18f-0d6c32769946_2560x1020.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!M62D!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6e32da8c-ef67-4a57-b18f-0d6c32769946_2560x1020.png 424w, /__u/substackcdn.com/image/fetch/$s_!M62D!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6e32da8c-ef67-4a57-b18f-0d6c32769946_2560x1020.png 848w, /__u/substackcdn.com/image/fetch/$s_!M62D!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6e32da8c-ef67-4a57-b18f-0d6c32769946_2560x1020.png 1272w, /__u/substackcdn.com/image/fetch/$s_!M62D!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6e32da8c-ef67-4a57-b18f-0d6c32769946_2560x1020.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>We&#8217;ve added support for many new models that you can now run and fine-tune locally, including Qwen3-Coder-Next, DeepSeek-OCR 2, GLM-4.7-Flash, Kimi-2.5, and more.</p><p> &#11088; We&#8217;d also like to thank all of you for<strong> 50K stars</strong> on GitHub: <a href="https://github.com/unslothai/unsloth">https://github.com/unslothai/unsloth</a></p><h3>&#128142; 12&#215; faster MoE training</h3><p>You can now train MoE models 12&#215; faster with <strong>&gt;35% less VRAM</strong> and <strong>6x longer context</strong> via our new Triton and math kernels (no accuracy loss). gpt-oss-20b works on <strong>12.8GB VRAM</strong>. Qwen3-30B-A3B (16-bit LoRA) uses 63GB.</p><p>Unsloth supports fast training for gpt-oss, Qwen3 (30B, 235B, VL, Coder), DeepSeek R1/V3 arch and GLM (4.7, Flash) models. The larger the model and more context you use, the more pronounced the memory savings from our Unsloth kernels will be.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://unsloth.ai/docs/new/faster-moe&quot;,&quot;text&quot;:&quot;Faster MoE Blog&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://unsloth.ai/docs/new/faster-moe"><span>Faster MoE Blog</span></a></p><h3>&#128270; Embedding models now train 2&#215; faster</h3><p>Fine-tuning embedding models can largely improve retrieval and RAG performance on specific tasks. We collaborated with Hugging Face to enable <strong>1.8-3.3x faster embedding</strong>, BERT and classifier model training with 20% less VRAM, 2x longer context &amp; no accuracy loss vs. FA2 setups. </p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://unsloth.ai/docs/new/embedding-finetuning&quot;,&quot;text&quot;:&quot;Embedding model Blog&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://unsloth.ai/docs/new/embedding-finetuning"><span>Embedding model Blog</span></a></p><h3>&#128161; Ultra Long Context RL is here</h3><p>Reinforcement learning&#8217;s (RL) biggest challenge is supporting long reasoning traces. Our new batching algorithms enable ~<strong>7x longer context </strong>(can be more than 12x)<strong> </strong>RL with no accuracy or speed degradation vs. other optimized setups that use FA3, kernels &amp; chunked losses. Unsloth trains gpt-oss QLoRA with <strong>380K context </strong>on a single 192GB NVIDIA B200 GPU</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://unsloth.ai/docs/new/grpo-long-context&quot;,&quot;text&quot;:&quot;Long Context RL Blog&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://unsloth.ai/docs/new/grpo-long-context"><span>Long Context RL Blog</span></a></p><h3>&#128302; New models</h3><ul><li><p><strong><a href="https://unsloth.ai/docs/models/qwen3-coder-next">&#127776; Qwen3-Coder-Next</a></strong>: Run the newly released coding model.</p></li><li><p><strong><a href="https://unsloth.ai/docs/models/deepseek-ocr-2">&#128051; DeepSeek-OCR 2</a> </strong>- Run and fine-tune the new OCR model.</p></li><li><p><a href="https://unsloth.ai/docs/models/kimi-k2.5">&#129373; </a><strong><a href="https://unsloth.ai/docs/models/kimi-k2.5">Kimi 2.5</a> </strong>- Run the SOTA model locally with Unsloth GGUFs.</p></li><li><p><a href="https://unsloth.ai/docs/models/glm-4.7-flash">&#9889; </a><strong><a href="https://unsloth.ai/docs/models/glm-4.7-flash">GLM-4.7-Flash</a></strong> - Run and fine-tune the best-in-class 30B LLM.</p></li></ul><h3>&#128214; New Guides</h3><ul><li><p>&lt;/&gt; How To Use Claude Code + Codex with local LLMs: <a href="https://unsloth.ai/docs/basics/claude-codex">Guide</a></p></li><li><p>&#128126; Train &amp; deploy to LM Studio for local inference: <a href="https://unsloth.ai/docs/basics/inference-and-deployment/lm-studio">Guide</a></p></li><li><p>&#127912; Run Diffusion image models with Unsloth GGUFs: <a href="https://unsloth.ai/docs/models/qwen-image-2512">Guide</a></p></li></ul><p>February is shaping up to be an amazing month for LLM releases, and we hope you&#8217;re just as excited as we are. &#128522;</p>]]></content:encoded></item><item><title><![CDATA[Unsloth December Update]]></title><description><![CDATA[Thanks for all the support this year!]]></description><link>https://unslothai.substack.com/p/unsloth-december-update</link><guid isPermaLink="false">https://unslothai.substack.com/p/unsloth-december-update</guid><dc:creator><![CDATA[Unsloth AI]]></dc:creator><pubDate>Thu, 18 Dec 2025 18:08:08 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/f1300d0e-e767-4c83-84cc-c43091c1d282_2151x1020.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Thanks for all the support this year! &#129392; In the past few weeks, we&#8217;ve got lots of Unsloth improvements and new models (from Google, NVIDIA, Mistral, and more). See below for the latest updates:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!QRI2!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b320719-e503-4e43-b436-eb1703bf976a_2560x1020.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!QRI2!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b320719-e503-4e43-b436-eb1703bf976a_2560x1020.png 424w, /__u/substackcdn.com/image/fetch/$s_!QRI2!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b320719-e503-4e43-b436-eb1703bf976a_2560x1020.png 848w, /__u/substackcdn.com/image/fetch/$s_!QRI2!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b320719-e503-4e43-b436-eb1703bf976a_2560x1020.png 1272w, /__u/substackcdn.com/image/fetch/$s_!QRI2!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b320719-e503-4e43-b436-eb1703bf976a_2560x1020.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!QRI2!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b320719-e503-4e43-b436-eb1703bf976a_2560x1020.png" width="1456" height="580" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/6b320719-e503-4e43-b436-eb1703bf976a_2560x1020.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:580,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:508500,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://unslothai.substack.com/i/181978508?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b320719-e503-4e43-b436-eb1703bf976a_2560x1020.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!QRI2!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b320719-e503-4e43-b436-eb1703bf976a_2560x1020.png 424w, /__u/substackcdn.com/image/fetch/$s_!QRI2!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b320719-e503-4e43-b436-eb1703bf976a_2560x1020.png 848w, /__u/substackcdn.com/image/fetch/$s_!QRI2!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b320719-e503-4e43-b436-eb1703bf976a_2560x1020.png 1272w, /__u/substackcdn.com/image/fetch/$s_!QRI2!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b320719-e503-4e43-b436-eb1703bf976a_2560x1020.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h3>&#10024; New Google model</h3><p>Google releases <strong>FunctionGemma</strong>, a new <strong>270M</strong> parameter model built for tool/function-calling. You can fine-tune it with Unsloth &amp; later run/deploy on your phone. Learn how with our guide.</p><p>Our notebook turns FunctionGemma into a reasoning model by making it &#8216;think&#8217; before tool-calling.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://docs.unsloth.ai/models/functiongemma&quot;,&quot;text&quot;:&quot;FunctionGemma Guide&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://docs.unsloth.ai/models/functiongemma"><span>FunctionGemma Guide</span></a></p><h3>&#129445; 3&#215; Faster Training</h3><p>You can now train <strong>3&#215; faster</strong> and use <strong>~30% less VRAM</strong> (with no accuracy loss) via new RoPE + MLP Triton kernels, padding-free training, and uncontaminated packing. Train Qwen3-4B 3&#215; faster on just <strong>3.9GB VRAM</strong>.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://docs.unsloth.ai/new/3x-faster-training-packing&quot;,&quot;text&quot;:&quot;3x Faster Blog&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://docs.unsloth.ai/new/3x-faster-training-packing"><span>3x Faster Blog</span></a></p><div><hr></div><p>We also added a preliminary <strong>multi-GPU support</strong>: <a href="https://docs.unsloth.ai/basics/multi-gpu-training-with-unsloth/ddp">DDP Guide</a><br>This is an early preview (the official release is expected early next year).</p><p><strong>&#129303;Transformers v5</strong> is now supported, too!</p><div><hr></div><h3>&#128241; Deploy LLMs on your phone</h3><p>We collaborated with PyTorch to enable you to fine-tune LLMs, and then directly deploy/run them on your phone. <strong><a href="https://docs.unsloth.ai/new/deploy-llms-phone">Read guide</a></strong></p><h3>&#129504; 500K context training</h3><p>You can now do 500K context-length fine-tuning with Unsloth! Train gpt-oss-20B to extend its context window to 530K on 80GB VRAM and 750K+ on 192GB, with no accuracy loss.</p><p>Unsloth&#8217;s new algorithms + our collaboration with Snowflake enable ~72% less VRAM and up to <strong>6&#215;</strong> longer context lengths. <strong><a href="https://docs.unsloth.ai/new/500k-context-length-fine-tuning">Read the blog</a></strong></p><h3>&#128154; NVIDIA Nemotron 3</h3><p>NVIDIA releases <strong>Nemotron 3</strong>, a new <strong>30B</strong> hybrid reasoning model. You can now fine-tune and run the model locally with Unsloth. <strong><a href="https://docs.unsloth.ai/models/nemotron-3">Nemotron 3 Guide</a></strong></p><p>Also thanks to NVIDIA for collabing on a blogpost and video on how to do reinforcement learning (RL) with Unsloth: <strong><a href="https://blogs.nvidia.com/blog/rtx-ai-garage-fine-tuning-unsloth-dgx-spark/">NVIDIA blog</a></strong> &#8226; <strong><a href="https://www.youtube.com/watch?v=9t-BAjzBWj8">Video Tutorial</a></strong></p><h3>&#128049; New Mistral models</h3><p>Mistral releases Devstral 2 and Mistral 3, new multimodal models that excel at coding + chat workflows: <strong><a href="https://docs.unsloth.ai/models/ministral-3">Ministral 3</a></strong> &#8226; <strong><a href="https://docs.unsloth.ai/models/devstral-2">Devstral 2</a></strong></p><p>You can fine-tune them all with Unsloth and we made a new reinforcement learning notebook for autonomously solving sudoku.</p><div><hr></div><p>And that&#8217;s it, hope you have a wonderful Christmas and happy holidays! &#127873;</p>]]></content:encoded></item><item><title><![CDATA[Unsloth Nov Update]]></title><description><![CDATA[We&#8217;re getting close to our final release of 2025!]]></description><link>https://unslothai.substack.com/p/unsloth-november-update</link><guid isPermaLink="false">https://unslothai.substack.com/p/unsloth-november-update</guid><dc:creator><![CDATA[Unsloth AI]]></dc:creator><pubDate>Tue, 25 Nov 2025 16:48:33 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!bwCh!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a5f706c-2eb0-45b8-a289-e65579c7e41e_2560x1020.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>We&#8217;re getting close to our final release of 2025! Thanks so much for sticking with us this year. We&#8217;ve got lots of new features like FP8 RL and collabs with OpenAI, NVIDIA and more! See below for our latest updates:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!bwCh!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a5f706c-2eb0-45b8-a289-e65579c7e41e_2560x1020.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!bwCh!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a5f706c-2eb0-45b8-a289-e65579c7e41e_2560x1020.png 424w, /__u/substackcdn.com/image/fetch/$s_!bwCh!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a5f706c-2eb0-45b8-a289-e65579c7e41e_2560x1020.png 848w, /__u/substackcdn.com/image/fetch/$s_!bwCh!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a5f706c-2eb0-45b8-a289-e65579c7e41e_2560x1020.png 1272w, /__u/substackcdn.com/image/fetch/$s_!bwCh!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a5f706c-2eb0-45b8-a289-e65579c7e41e_2560x1020.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!bwCh!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a5f706c-2eb0-45b8-a289-e65579c7e41e_2560x1020.png" width="1456" height="580" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/2a5f706c-2eb0-45b8-a289-e65579c7e41e_2560x1020.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:580,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1127090,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://unslothai.substack.com/i/179908535?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a5f706c-2eb0-45b8-a289-e65579c7e41e_2560x1020.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!bwCh!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a5f706c-2eb0-45b8-a289-e65579c7e41e_2560x1020.png 424w, /__u/substackcdn.com/image/fetch/$s_!bwCh!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a5f706c-2eb0-45b8-a289-e65579c7e41e_2560x1020.png 848w, /__u/substackcdn.com/image/fetch/$s_!bwCh!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a5f706c-2eb0-45b8-a289-e65579c7e41e_2560x1020.png 1272w, /__u/substackcdn.com/image/fetch/$s_!bwCh!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a5f706c-2eb0-45b8-a289-e65579c7e41e_2560x1020.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h3>&#9889;FP8 Reinforcement Learning</h3><p>DeepSeek-R1 demonstrated how powerful FP8 can be, and faster RL inference is essential as it&#8217;s the most compute-intensive part of the workload. We&#8217;re introducing FP8-precision training for RL, making FP8 GRPO now possible on consumer GPUs (NVIDIA RTX 40, 50 etc).</p><p>Qwen3-1.7B FP8 GRPO now works on just <strong>5GB of VRAM</strong>. We collabed with PyTorch for ~1.4&#215; faster FP8 RL inference vs FP16 (even more at longer context). FP8 GRPO benefits from Unsloth&#8217;s features like weight sharing, Flex Attention, making it use 60% less VRAM and have 10x longer context than other implementations.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://docs.unsloth.ai/new/fp8-reinforcement-learning&quot;,&quot;text&quot;:&quot;FP8 RL Blog&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://docs.unsloth.ai/new/fp8-reinforcement-learning"><span>FP8 RL Blog</span></a></p><p>We also dug into the issue <strong><a href="https://docs.unsloth.ai/get-started/reinforcement-learning-rl-guide/fp16-vs-bf16-for-rl">RL reward mismatch</a></strong> when using FP16 vs BF16 and found Unsloth does not have this issue.</p><h4>Even better Unsloth!</h4><p>You may notice Unsloth now uses much less VRAM than before, enabling even longer context. We&#8217;re also implementing faster training very soon and we&#8217;ll share all the details in an upcoming blog.</p><h3>&#128640; OpenAI DevDay collab</h3><p>We collabed with OpenAI on a gpt-oss RL notebook that autonomously beats the 2048 game using RL. Training was done locally with Unsloth on NVIDIA DGX Spark. Our notebook example was showcased at <a href="https://docs.unsloth.ai/basics/fine-tuning-llms-with-nvidia-dgx-spark-and-unsloth">OpenAI DevDay 2025</a>.</p><h3>&#128154; NVIDIA support</h3><p><strong><a href="https://docs.unsloth.ai/basics/fine-tuning-llms-with-nvidia-dgx-spark-and-unsloth">NVIDIA DGX Spark</a></strong>: Unsloth enables local fine-tuning of LLMs with up to <strong>200B parameters</strong> on the NVIDIA DGX&#8482; Spark. With 128 GB of unified memory, you can train massive models such as <strong>gpt-oss-120b</strong>, and run or deploy inference directly on DGX Spark.</p><p><strong><a href="https://docs.unsloth.ai/basics/fine-tuning-llms-with-blackwell-rtx-50-series-and-unsloth">Blackwell / RTX 50 series</a>: </strong>Unsloth now supports NVIDIA&#8217;s Blackwell architecture GPUs, including RTX 50-series GPUs (5060&#8211;5090), RTX PRO 6000, and GPUs such as B200, GB100 and more! You can read our collab on the official <a href="https://developer.nvidia.com/blog/train-an-llm-on-an-nvidia-blackwell-desktop-with-unsloth-and-scale-it/">NVIDIA blogpost</a>.</p><h3>&#128011; DeepSeek-OCR</h3><p>DeepSeek-OCR is a 3B-parameter vision model for OCR and document understanding. It uses <em>context optical compression</em> to convert 2D layouts into vision tokens, enabling efficient long-context processing.</p><p><strong><a href="https://docs.unsloth.ai/new/deepseek-ocr-how-to-run-and-fine-tune">Fine-tune DeepSeek-OCR</a></strong> to enhance its vision or language performance. In our Unsloth free fine-tuning notebook, we demonstrated a 88.26% improvement for language understanding.</p><h3>&#127919; Quantization-Aware Training (QAT)</h3><p>We <a href="https://docs.unsloth.ai/basics/quantization-aware-training-qat">worked with TorchAO</a> to enable trainable quantization that recovers as much accuracy as possible. This results in significantly better model quality compared to standard 4-bit naive quantization.</p><p>QAT can recover up to <strong>70% of the lost accuracy</strong> and achieve a 1-3% model performance improvement on benchmarks such as GPQA and MMLU Pro.</p><h3>&#128051; Run LLMs locally via Docker &#215; Unsloth</h3><p>You can run any model, including Unsloth Dynamic GGUFs, on Mac, Windows or Linux with a <a href="https://docs.unsloth.ai/models/how-to-run-llms-with-docker">single line of code or </a><strong><a href="https://docs.unsloth.ai/models/how-to-run-llms-with-docker">no code</a></strong><a href="https://docs.unsloth.ai/models/how-to-run-llms-with-docker"> at all</a>. We collabed with Docker to simplify model deployment, and Unsloth now powers most of Docker&#8217;s GGUF models.</p><h3>&#128302; Qwen3-VL</h3><p>Qwen3-VL is Qwen&#8217;s new vision models with instruct and thinking versions. The 2B, 4B, 8B and 32B models are dense, while 30B and 235B are MoE. <a href="https://docs.unsloth.ai/models/qwen3-vl-how-to-run-and-fine-tune">Unsloth supports Qwen3-VL fine-tuning and RL</a> and Qwen3-VL (8B) can be trained for free with our notebooks.</p><div><hr></div><p>Hope you have a lovely Thanksgiving (if you celebrate it) otherwise, a lovely rest of the week! =)</p>]]></content:encoded></item><item><title><![CDATA[Unsloth new Reinforcement Learning]]></title><description><![CDATA[We&#8217;ve got lots of Unsloth updates especially for RL.]]></description><link>https://unslothai.substack.com/p/unsloths-new-reinforcement-learning</link><guid isPermaLink="false">https://unslothai.substack.com/p/unsloths-new-reinforcement-learning</guid><dc:creator><![CDATA[Unsloth AI]]></dc:creator><pubDate>Thu, 02 Oct 2025 16:26:44 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!tf8R!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F38db2434-2d78-41f9-8927-968662f02651_2560x964.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>As Reinforcement Learning (RL) continues to gain momentum, our mission at Unsloth is to make it easier and more accessible for everyone. We&#8217;re introducing many new RL capabilities, including support for OpenAI&#8217;s gpt-oss, vision models, and more memory-efficient RL. Plus, our new gpt-oss RL inference achieves the fastest tokens/s vs. any implementation.<br><br>Beyond RL, Unsloth is also focused on accuracy and quants. Third-party Aider Polyglot benchmarks for Unsloth DeepSeek-V3.1 Dynamic GGUFs revealed that the 3-bit GGUF achieved 75.6% on Aider, only 0.5% lower than the full precision unquantized model. This 75.6% score surpasses SOTA models such as Claude-4-Opus (thinking) and GPT-4.1.</p><p>Aider is one of the most comprehensive benchmarks to test how well LLMs can write, code, follow instructions, and apply changes without human intervention.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://docs.unsloth.ai/new/unsloth-dynamic-ggufs-on-aider-polyglot&quot;,&quot;text&quot;:&quot;DeepSeek GGUF Results&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://docs.unsloth.ai/new/unsloth-dynamic-ggufs-on-aider-polyglot"><span>DeepSeek GGUF Results</span></a></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!tf8R!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F38db2434-2d78-41f9-8927-968662f02651_2560x964.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!tf8R!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F38db2434-2d78-41f9-8927-968662f02651_2560x964.png 424w, /__u/substackcdn.com/image/fetch/$s_!tf8R!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F38db2434-2d78-41f9-8927-968662f02651_2560x964.png 848w, /__u/substackcdn.com/image/fetch/$s_!tf8R!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F38db2434-2d78-41f9-8927-968662f02651_2560x964.png 1272w, /__u/substackcdn.com/image/fetch/$s_!tf8R!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F38db2434-2d78-41f9-8927-968662f02651_2560x964.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!tf8R!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F38db2434-2d78-41f9-8927-968662f02651_2560x964.png" width="1456" height="548" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/38db2434-2d78-41f9-8927-968662f02651_2560x964.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:548,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:975208,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://unslothai.substack.com/i/174527680?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F38db2434-2d78-41f9-8927-968662f02651_2560x964.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!tf8R!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F38db2434-2d78-41f9-8927-968662f02651_2560x964.png 424w, /__u/substackcdn.com/image/fetch/$s_!tf8R!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F38db2434-2d78-41f9-8927-968662f02651_2560x964.png 848w, /__u/substackcdn.com/image/fetch/$s_!tf8R!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F38db2434-2d78-41f9-8927-968662f02651_2560x964.png 1272w, /__u/substackcdn.com/image/fetch/$s_!tf8R!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F38db2434-2d78-41f9-8927-968662f02651_2560x964.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>To make training easier, Unsloth now has a <strong>Docker image</strong>: Just run the container on Windows or Linux and start training without dependency issues. <strong><a href="https://docs.unsloth.ai/new/how-to-train-llms-with-unsloth-and-docker">Guide</a></strong></p><p>Here are rest of the Unsloth news:</p><h4><strong>&#129445;  Unsloth Updates</strong></h4><ul><li><p>Inference is crucial in RL training. To achieve the <strong>fastest inference</strong> speed for gpt-oss without vLLM, we rewrote Transformers to enable at least 3&#215; faster inference for gpt-oss. You can train gpt-oss with GRPO/GSPO in our Colab notebook, where we showcase how you can automatically create <strong>faster GPU kernels</strong>.</p></li></ul><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://docs.unsloth.ai/new/gpt-oss-reinforcement-learning&quot;,&quot;text&quot;:&quot;gpt-oss RL Blog&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://docs.unsloth.ai/new/gpt-oss-reinforcement-learning"><span>gpt-oss RL Blog</span></a></p><ul><li><p><strong>Vision RL</strong> is here with Gemma 3, Qwen2.5-VL and other vision models. Due to Unsloth&#8217;s unique weight sharing and custom kernels, Unsloth makes VLM RL 1.5&#8211;2&#215; faster, use 90% less VRAM, and enables 10&#215; longer context lengths than FA2 setups, with no accuracy loss.</p></li></ul><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://docs.unsloth.ai/new/vision-reinforcement-learning-vlm-rl&quot;,&quot;text&quot;:&quot;Vision RL Blog&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://docs.unsloth.ai/new/vision-reinforcement-learning-vlm-rl"><span>Vision RL Blog</span></a></p><ul><li><p><strong>IBM releases Granite-4.0</strong> today, and Unsloth has Day Zero support. You can run with our Dynamic GGUFs or fine-tuning notebook which has a support agent example. <strong><a href="https://docs.unsloth.ai/new/ibm-granite-4.0">Guide</a></strong></p></li><li><p>RL is now even faster &amp; more memory efficient! Our new kernels &amp; algos allows faster RL with 50% less VRAM &amp; 10&#215; more context. <strong><a href="https://docs.unsloth.ai/basics/memory-efficient-rl">Blog</a></strong></p></li><li><p>Introducing <strong>Unsloth Flex Attention</strong> for gpt-oss that enables &gt;8&#215; longer context, &gt;50% less VRAM and &gt;1.5&#215; faster. <strong><a href="https://docs.unsloth.ai/basics/long-context-gpt-oss-training">Blog</a></strong></p></li><li><p>We&#8217;re hosting a Developer event with Mistral AI &amp; NVIDIA at Y Combinator&#8217;s Office in San Francisco on Oct 21. <strong><a href="https://luma.com/unsloth-yc">Come say hello!</a></strong></p></li></ul><p>We&#8217;ve got lots of new collabs and features over the next few weeks including a new product launch so stay tuned!</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.reddit.com/r/unsloth/&quot;,&quot;text&quot;:&quot;r/unsloth Reddit&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://www.reddit.com/r/unsloth/"><span>r/unsloth Reddit</span></a></p><p></p>]]></content:encoded></item><item><title><![CDATA[OpenAI gpt-oss now in Unsloth ✨]]></title><description><![CDATA[Fine-tune & run gpt-oss with Unsloth]]></description><link>https://unslothai.substack.com/p/openai-gpt-oss-now-in-unsloth</link><guid isPermaLink="false">https://unslothai.substack.com/p/openai-gpt-oss-now-in-unsloth</guid><dc:creator><![CDATA[Unsloth AI]]></dc:creator><pubDate>Fri, 08 Aug 2025 19:28:19 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!e-si!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbdfed12d-0b7c-48ab-9b46-318335097079_2560x963.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>You can now fine-tune OpenAI&#8217;s <strong>gpt-oss</strong> models with Unsloth! You can also run the model locally by using our GGUFs.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!e-si!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbdfed12d-0b7c-48ab-9b46-318335097079_2560x963.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!e-si!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbdfed12d-0b7c-48ab-9b46-318335097079_2560x963.png 424w, /__u/substackcdn.com/image/fetch/$s_!e-si!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbdfed12d-0b7c-48ab-9b46-318335097079_2560x963.png 848w, /__u/substackcdn.com/image/fetch/$s_!e-si!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbdfed12d-0b7c-48ab-9b46-318335097079_2560x963.png 1272w, /__u/substackcdn.com/image/fetch/$s_!e-si!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbdfed12d-0b7c-48ab-9b46-318335097079_2560x963.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!e-si!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbdfed12d-0b7c-48ab-9b46-318335097079_2560x963.png" width="1456" height="548" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/bdfed12d-0b7c-48ab-9b46-318335097079_2560x963.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:548,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:537183,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://unslothai.substack.com/i/170355580?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbdfed12d-0b7c-48ab-9b46-318335097079_2560x963.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!e-si!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbdfed12d-0b7c-48ab-9b46-318335097079_2560x963.png 424w, /__u/substackcdn.com/image/fetch/$s_!e-si!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbdfed12d-0b7c-48ab-9b46-318335097079_2560x963.png 848w, /__u/substackcdn.com/image/fetch/$s_!e-si!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbdfed12d-0b7c-48ab-9b46-318335097079_2560x963.png 1272w, /__u/substackcdn.com/image/fetch/$s_!e-si!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbdfed12d-0b7c-48ab-9b46-318335097079_2560x963.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>We also investigated gpt-oss and did some <a href="https://docs.unsloth.ai/basics/gpt-oss-how-to-run-and-fine-tune#unsloth-fixes-for-gpt-oss">chat template fixes</a> so make sure to use Unsloth for training &amp; our quants.</p><p>All other training libraries/methods will require a minimum of 65GB VRAM to train gpt-oss-20b, while Unsloth only requires 14GB VRAM. The 120b gpt-oss model fits in 65GB VRAM.</p><ul><li><p>Fine-tune gpt-oss-20b for free with our Google Colab notebook</p></li><li><p>View all our gpt-oss model uploads with fixes analysis and Guide:</p></li></ul><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://docs.unsloth.ai/basics/gpt-oss-how-to-run-and-fine-tune&quot;,&quot;text&quot;:&quot;gpt-oss Blog&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://docs.unsloth.ai/basics/gpt-oss-how-to-run-and-fine-tune"><span>gpt-oss Blog</span></a></p><h4><strong>&#129445; Unsloth Updates</strong></h4><ul><li><p>Our newest updated speeds up <strong>every</strong> single model while also reducing VRAM usage by &gt;20%.</p></li><li><p>Qwen upgraded Qwen3 and launched their SOTA coding models! Fine-tune and run Qwen3-Coder and Qwen-2507 with Unsloth.</p><p></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://docs.unsloth.ai/basics/qwen3&quot;,&quot;text&quot;:&quot;Qwen3 Guide&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://docs.unsloth.ai/basics/qwen3"><span>Qwen3 Guide</span></a></p><p></p></li></ul>]]></content:encoded></item><item><title><![CDATA[Unsloth - Google Gemma 3n & TTS]]></title><description><![CDATA[Google's new Gemma 3n model and Text-to-speech support]]></description><link>https://unslothai.substack.com/p/unsloth-google-gemma-3n-and-tts</link><guid isPermaLink="false">https://unslothai.substack.com/p/unsloth-google-gemma-3n-and-tts</guid><dc:creator><![CDATA[Unsloth AI]]></dc:creator><pubDate>Tue, 01 Jul 2025 16:15:18 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!2wkn!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F379a5449-6d26-4603-81ea-527d964959b1_2560x1020.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div><hr></div><p>Happy July! &#129445; We&#8217;re excited to introduce lots of new updates for Unsloth:</p><h3>&#10024; Gemma 3n</h3><p>Run and fine-tune Google&#8217;s new Gemma 3n models. Gemma 3n supports text, image, video, and audio with 32K context. We&#8217;ve uploaded Dynamic quants, GGUFs, and released fine-tuning notebooks.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://docs.unsloth.ai/basics/gemma-3n-how-to-run-and-fine-tune&quot;,&quot;text&quot;:&quot;Gemma 3n Blog&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://docs.unsloth.ai/basics/gemma-3n-how-to-run-and-fine-tune"><span>Gemma 3n Blog</span></a></p><h3>&#129445; Unsloth Updates</h3><ul><li><p>We&#8217;ve released a new GitHub repo featuring <a href="https://github.com/unslothai/notebooks">100+ Unsloth notebooks </a></p></li><li><p>Qwen3 <a href="https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen3_(4B)-GRPO.ipynb">Advanced GRPO notebook</a> with our new proximity scoring reward function and priming stage to skip GRPO format learning</p></li><li><p>Unsloth now supports the latest vLLM, TRL, and Transformers.</p></li><li><p>New <a href="https://docs.unsloth.ai/basics/reinforcement-learning-guide">Reinforcement Learning (RL)</a> and <a href="https://docs.unsloth.ai/get-started/fine-tuning-guide/lora-hyperparameters-guide">LoRA hyperparameter</a> guide</p></li></ul><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!2wkn!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F379a5449-6d26-4603-81ea-527d964959b1_2560x1020.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!2wkn!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F379a5449-6d26-4603-81ea-527d964959b1_2560x1020.png 424w, /__u/substackcdn.com/image/fetch/$s_!2wkn!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F379a5449-6d26-4603-81ea-527d964959b1_2560x1020.png 848w, /__u/substackcdn.com/image/fetch/$s_!2wkn!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F379a5449-6d26-4603-81ea-527d964959b1_2560x1020.png 1272w, /__u/substackcdn.com/image/fetch/$s_!2wkn!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F379a5449-6d26-4603-81ea-527d964959b1_2560x1020.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!2wkn!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F379a5449-6d26-4603-81ea-527d964959b1_2560x1020.png" width="728.0000610351562" height="290.00002431345507" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/379a5449-6d26-4603-81ea-527d964959b1_2560x1020.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:false,&quot;imageSize&quot;:&quot;normal&quot;,&quot;height&quot;:580,&quot;width&quot;:1456,&quot;resizeWidth&quot;:728.0000610351562,&quot;bytes&quot;:1082350,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://unslothai.substack.com/i/167271784?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F379a5449-6d26-4603-81ea-527d964959b1_2560x1020.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:&quot;center&quot;,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!2wkn!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F379a5449-6d26-4603-81ea-527d964959b1_2560x1020.png 424w, /__u/substackcdn.com/image/fetch/$s_!2wkn!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F379a5449-6d26-4603-81ea-527d964959b1_2560x1020.png 848w, /__u/substackcdn.com/image/fetch/$s_!2wkn!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F379a5449-6d26-4603-81ea-527d964959b1_2560x1020.png 1272w, /__u/substackcdn.com/image/fetch/$s_!2wkn!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F379a5449-6d26-4603-81ea-527d964959b1_2560x1020.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h3>&#128266; Text-to-Speech (TTS)</h3><p>Unsloth supports TTS and Speech-to-text (STT) models including Sesame-CSM, Orpheus, OpenAI&#8217;s Whisper. We also made extensive notebooks for TTS and a Guide.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://docs.unsloth.ai/basics/text-to-speech-tts-fine-tuning&quot;,&quot;text&quot;:&quot;TTS Guide&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://docs.unsloth.ai/basics/text-to-speech-tts-fine-tuning"><span>TTS Guide</span></a></p><h3>&#128051; DeepSeek-R1-0528</h3><p>DeepSeek&#8217;s R1 update is here. Fine-tune DeepSeek-R1-0528-Qwen3 with GRPO. Our notebook features a new reward function which increases multilingual response rates by 40%.</p><p>Our Dynamic 1-bit GGUFs shrink the full 715GB model to 162GB (-80% size).</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://docs.unsloth.ai/basics/deepseek-r1-0528-how-to-run-locally&quot;,&quot;text&quot;:&quot;R1-0528 Blog&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://docs.unsloth.ai/basics/deepseek-r1-0528-how-to-run-locally"><span>R1-0528 Blog</span></a></p><div><hr></div>]]></content:encoded></item><item><title><![CDATA[Unsloth - Qwen3 & Dynamic 2.0]]></title><description><![CDATA[Introducing Dynamic 2.0 quants and Qwen3.]]></description><link>https://unslothai.substack.com/p/unsloth-qwen3-and-dynamic-20</link><guid isPermaLink="false">https://unslothai.substack.com/p/unsloth-qwen3-and-dynamic-20</guid><dc:creator><![CDATA[Unsloth AI]]></dc:creator><pubDate>Fri, 02 May 2025 16:38:56 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!l8l3!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b079169-032d-42e7-a131-a81f78697744_2560x750.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>We&#8217;re excited to introduce <a href="https://docs.unsloth.ai/basics/unsloth-dynamic-2.0-ggufs">Unsloth Dynamic 2.0</a> which outperforms leading quantization methods and sets new benchmarks for 5-shot MMLU and KL Divergence. This means you can now run + fine-tune quantized LLMs with minimal accuracy loss!</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!l8l3!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b079169-032d-42e7-a131-a81f78697744_2560x750.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!l8l3!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b079169-032d-42e7-a131-a81f78697744_2560x750.png 424w, /__u/substackcdn.com/image/fetch/$s_!l8l3!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b079169-032d-42e7-a131-a81f78697744_2560x750.png 848w, /__u/substackcdn.com/image/fetch/$s_!l8l3!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b079169-032d-42e7-a131-a81f78697744_2560x750.png 1272w, /__u/substackcdn.com/image/fetch/$s_!l8l3!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b079169-032d-42e7-a131-a81f78697744_2560x750.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!l8l3!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b079169-032d-42e7-a131-a81f78697744_2560x750.png" width="1456" height="427" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/9b079169-032d-42e7-a131-a81f78697744_2560x750.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:427,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:474570,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://unslothai.substack.com/i/162684754?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b079169-032d-42e7-a131-a81f78697744_2560x750.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!l8l3!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b079169-032d-42e7-a131-a81f78697744_2560x750.png 424w, /__u/substackcdn.com/image/fetch/$s_!l8l3!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b079169-032d-42e7-a131-a81f78697744_2560x750.png 848w, /__u/substackcdn.com/image/fetch/$s_!l8l3!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b079169-032d-42e7-a131-a81f78697744_2560x750.png 1272w, /__u/substackcdn.com/image/fetch/$s_!l8l3!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b079169-032d-42e7-a131-a81f78697744_2560x750.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>The new Qwen3 models deliver advancements in reasoning, instruction-following and multilingual support.</p><p>You can fine-tune Qwen3 up to <strong>8x longer context lengths</strong> with Unsloth compared to all setups with FA2 on a 24GB GPU. Qwen3-30B-A3B comfortably fits on 17.5GB VRAM. We released a Colab notebook for <a href="https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen3_(14B)-Reasoning-Conversational.ipynb">Qwen3 (14B) here</a>.</p><p>We uploaded Qwen3 GGUFs using our Unsloth Dynamic 2.0 method and also uploaded Qwen3 with native 128K context windows (up from 40K).</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://docs.unsloth.ai/basics/qwen3-how-to-run-and-fine-tune&quot;,&quot;text&quot;:&quot;Read Qwen3 Blog&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://docs.unsloth.ai/basics/qwen3-how-to-run-and-fine-tune"><span>Read Qwen3 Blog</span></a></p><h3>Other Highlights:</h3><ul><li><p>Meta released Llama 4 in Scout and Maverick variants. You can run them locally with our Dynamic 2.0 GGUFs.</p></li><li><p>We collaborated with Meta on a <a href="https://www.linkedin.com/feed/update/urn:li:activity:7323725798346010625">Synthetic Datasets notebook</a>.</p></li><li><p>Microsoft released their new reasoning models for Phi-4 which you can now run or fine-tune with Unsloth.</p></li></ul><div><hr></div><p>Thank you! If this email landed in your "Promotions" tab, drag it to your "Primary" inbox and &#11088;&#65039;Star it to ensure you don&#8217;t miss an update from us. We appreciate your support!</p>]]></content:encoded></item><item><title><![CDATA[Google Gemma 3 now in Unsloth]]></title><description><![CDATA[Gemma 3 and Reasoning is here!]]></description><link>https://unslothai.substack.com/p/google-gemma-3-now-in-unsloth</link><guid isPermaLink="false">https://unslothai.substack.com/p/google-gemma-3-now-in-unsloth</guid><dc:creator><![CDATA[Unsloth AI]]></dc:creator><pubDate>Fri, 14 Mar 2025 23:30:39 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!iKMh!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd4bcc147-f6a3-4c35-a1aa-11003725e9ac_2560x1020.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Gemma 3, Google's new multimodal (text + image) model, is now supported in Unsloth! It comes in 1B, 4B, 12B, and 27B sizes, has multilingual support and a 128K context window.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!iKMh!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd4bcc147-f6a3-4c35-a1aa-11003725e9ac_2560x1020.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!iKMh!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd4bcc147-f6a3-4c35-a1aa-11003725e9ac_2560x1020.png 424w, /__u/substackcdn.com/image/fetch/$s_!iKMh!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd4bcc147-f6a3-4c35-a1aa-11003725e9ac_2560x1020.png 848w, /__u/substackcdn.com/image/fetch/$s_!iKMh!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd4bcc147-f6a3-4c35-a1aa-11003725e9ac_2560x1020.png 1272w, /__u/substackcdn.com/image/fetch/$s_!iKMh!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd4bcc147-f6a3-4c35-a1aa-11003725e9ac_2560x1020.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!iKMh!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd4bcc147-f6a3-4c35-a1aa-11003725e9ac_2560x1020.png" width="1456" height="580" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d4bcc147-f6a3-4c35-a1aa-11003725e9ac_2560x1020.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:580,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:765609,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://unslothai.substack.com/i/158984833?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd4bcc147-f6a3-4c35-a1aa-11003725e9ac_2560x1020.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!iKMh!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd4bcc147-f6a3-4c35-a1aa-11003725e9ac_2560x1020.png 424w, /__u/substackcdn.com/image/fetch/$s_!iKMh!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd4bcc147-f6a3-4c35-a1aa-11003725e9ac_2560x1020.png 848w, /__u/substackcdn.com/image/fetch/$s_!iKMh!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd4bcc147-f6a3-4c35-a1aa-11003725e9ac_2560x1020.png 1272w, /__u/substackcdn.com/image/fetch/$s_!iKMh!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd4bcc147-f6a3-4c35-a1aa-11003725e9ac_2560x1020.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Unsloth also now supports: full finetuning, reasoning (GRPO), 8-bit, pretraining, <strong>nearly all models</strong> (Mixtral, MOE, Cohere) etc. <strong>MultiGPU support</strong> is coming very soon.</p><p>We&#8217;d like to thank the Gemma team for their support and for featuring Unsloth in their release blogpost. Gemma 3 Training<strong> free notebooks </strong>and <strong>guide</strong>: </p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://unsloth.ai/blog/gemma3&quot;,&quot;text&quot;:&quot;Gemma 3 Blog&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://unsloth.ai/blog/gemma3"><span>Gemma 3 Blog</span></a></p><h3><br>Reasoning (GRPO) Support</h3><p>Unsloth enables ten times more context lengths and uses 90% less VRAM for GRPO which was the algorithm DeepSeek used to train R1. Unsloth allows you to train your own reasoning model with just 5GB of VRAM using Qwen2.5 (1.5B).</p><p>With 24GB VRAM, you&#8217;ll be able to transform any model up to 24B in parameters, like Gemma 3 (12B), Llama 3.1 (8B) and Phi-4 (14B) into reasoning models.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://unsloth.ai/blog/grpo&quot;,&quot;text&quot;:&quot;R1 Reasoning Blog&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://unsloth.ai/blog/grpo"><span>R1 Reasoning Blog</span></a></p><div><hr></div><p>Thank you! If this email landed in your "Promotions" tab, drag it to your "Primary" inbox and &#11088;&#65039;Star it to ensure you don&#8217;t miss an update from us. We appreciate your support!</p>]]></content:encoded></item><item><title><![CDATA[Microsoft's Phi-4 now in Unsloth!]]></title><description><![CDATA[Hope you all had an amazing New Year!]]></description><link>https://unslothai.substack.com/p/microsofts-phi-4-now-in-unsloth</link><guid isPermaLink="false">https://unslothai.substack.com/p/microsofts-phi-4-now-in-unsloth</guid><dc:creator><![CDATA[Unsloth AI]]></dc:creator><pubDate>Fri, 10 Jan 2025 18:24:01 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!Sldt!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3e4035ab-98aa-48e2-bba3-d5efd3196a32_2560x1020.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://unsloth.ai/" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!Sldt!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3e4035ab-98aa-48e2-bba3-d5efd3196a32_2560x1020.png 424w, /__u/substackcdn.com/image/fetch/$s_!Sldt!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3e4035ab-98aa-48e2-bba3-d5efd3196a32_2560x1020.png 848w, /__u/substackcdn.com/image/fetch/$s_!Sldt!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3e4035ab-98aa-48e2-bba3-d5efd3196a32_2560x1020.png 1272w, /__u/substackcdn.com/image/fetch/$s_!Sldt!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3e4035ab-98aa-48e2-bba3-d5efd3196a32_2560x1020.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!Sldt!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3e4035ab-98aa-48e2-bba3-d5efd3196a32_2560x1020.png" width="1456" height="580" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/3e4035ab-98aa-48e2-bba3-d5efd3196a32_2560x1020.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:580,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:466199,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:&quot;https://unsloth.ai/&quot;,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!Sldt!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3e4035ab-98aa-48e2-bba3-d5efd3196a32_2560x1020.png 424w, /__u/substackcdn.com/image/fetch/$s_!Sldt!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3e4035ab-98aa-48e2-bba3-d5efd3196a32_2560x1020.png 848w, /__u/substackcdn.com/image/fetch/$s_!Sldt!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3e4035ab-98aa-48e2-bba3-d5efd3196a32_2560x1020.png 1272w, /__u/substackcdn.com/image/fetch/$s_!Sldt!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3e4035ab-98aa-48e2-bba3-d5efd3196a32_2560x1020.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Hope you all had an amazing New Year! Here's our latest updates:</p><div><hr></div><h3>&#10024; Microsoft Phi-4</h3><ul><li><p>Phi-4, Microsoft's new 14B model that performs on par with OpenAI's GPT-4o-mini is now in Unsloth!</p></li><li><p>We <a href="https://unsloth.ai/blog/phi4">fixed 4 bugs</a> in Phi-4, greatly increasing the model&#8217;s accuracy.</p></li><li><p>Unsloth Phi-4 finetuning enables &gt;128K context lengths</p></li></ul><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://unsloth.ai/blog/phi4&quot;,&quot;text&quot;:&quot;Read Phi-4 Blog&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://unsloth.ai/blog/phi4"><span>Read Phi-4 Blog</span></a></p><div><hr></div><h3>&#129433; Llama 3.3 + Ultra long context</h3><ul><li><p>Llama 3.3 is Meta&#8217;s new 70B model that performs on par with Llama 405B.</p></li><li><p><a href="https://unsloth.ai/blog/llama3-3">We worked with Apple</a> to integrate CCE, making Unsloth now support 13x longer context lengths.</p></li></ul><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://unsloth.ai/blog/llama3-3&quot;,&quot;text&quot;:&quot;Read Llama 3.3 Blog&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://unsloth.ai/blog/llama3-3"><span>Read Llama 3.3 Blog</span></a></p><div><hr></div><h3>&#129445; Unsloth Dynamic 4-bit</h3><ul><li><p>We&#8217;re also excited to introduce Unsloth <a href="https://unsloth.ai/blog/dynamic-4bit">Dynamic 4-bit Quantization</a>!</p></li><li><p>Unlike naive quantization, which reduces accuracy, our method selectively avoids quantizing certain parameters, achieving significantly higher accuracy, while only using &lt;10% more VRAM than BitsandBytes 4-bit.</p></li></ul><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://unsloth.ai/blog/dynamic-4bit" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!ytiL!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F248a0111-d235-4bb4-a5c9-8be12030d389_2200x2200.png 424w, /__u/substackcdn.com/image/fetch/$s_!ytiL!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F248a0111-d235-4bb4-a5c9-8be12030d389_2200x2200.png 848w, /__u/substackcdn.com/image/fetch/$s_!ytiL!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F248a0111-d235-4bb4-a5c9-8be12030d389_2200x2200.png 1272w, /__u/substackcdn.com/image/fetch/$s_!ytiL!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F248a0111-d235-4bb4-a5c9-8be12030d389_2200x2200.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!ytiL!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F248a0111-d235-4bb4-a5c9-8be12030d389_2200x2200.png" width="1456" height="1456" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/248a0111-d235-4bb4-a5c9-8be12030d389_2200x2200.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1456,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1866662,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:&quot;https://unsloth.ai/blog/dynamic-4bit&quot;,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!ytiL!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F248a0111-d235-4bb4-a5c9-8be12030d389_2200x2200.png 424w, /__u/substackcdn.com/image/fetch/$s_!ytiL!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F248a0111-d235-4bb4-a5c9-8be12030d389_2200x2200.png 848w, /__u/substackcdn.com/image/fetch/$s_!ytiL!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F248a0111-d235-4bb4-a5c9-8be12030d389_2200x2200.png 1272w, /__u/substackcdn.com/image/fetch/$s_!ytiL!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F248a0111-d235-4bb4-a5c9-8be12030d389_2200x2200.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://docs.unsloth.ai/&quot;,&quot;text&quot;:&quot;View our Docs&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://docs.unsloth.ai/"><span>View our Docs</span></a></p>]]></content:encoded></item><item><title><![CDATA[Unsloth - Llama 3.2 Vision Finetuning now supported]]></title><description><![CDATA[Meta's Llama 3.2 vision models are now supported in Unsloth in 11B and 90B sizes.]]></description><link>https://unslothai.substack.com/p/unsloth-llama-32-vision-finetuning</link><guid isPermaLink="false">https://unslothai.substack.com/p/unsloth-llama-32-vision-finetuning</guid><dc:creator><![CDATA[Unsloth AI]]></dc:creator><pubDate>Thu, 21 Nov 2024 18:37:24 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!8rSj!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa0440fe9-70bf-4b40-942a-51e326173c00_2560x1140.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Vision models are now supported in Unsloth including Meta&#8217;s <a href="https://huggingface.co/collections/unsloth/llama-32-vision-673b04868f51fde3c5786e72">Llama 3.2 (11B + 90B</a>) models. <a href="https://github.com/unslothai/unsloth">Unsloth</a> makes vision fine-tuning 2x faster and uses up to 70% less memory.<br>Read our blog: https://unsloth.ai/blog/vision</p><p>To train your own custom Llama 3.2 Vision model, we uploaded Google Colab <a href="https://docs.unsloth.ai/get-started/unsloth-notebooks">notebooks</a> to fine-tune for free:</p><ul><li><p><a href="https://colab.research.google.com/drive/1j0N4XTY1zXXy7mPAhOC1_gMYZ2F2EBlk?usp=sharing">Llama 3.2 Vision (11B)</a></p></li></ul><p>Other multimodal models like Llava, Pixtral and Qwen VL are also supported. We <a href="https://docs.unsloth.ai/get-started/all-our-models">uploaded</a> models in GGUF, 16-bit and 4-bit formats. You can also now <a href="https://huggingface.co/unsloth">follow us on Hugging Face</a>.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://unsloth.ai/blog/vision" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!8rSj!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa0440fe9-70bf-4b40-942a-51e326173c00_2560x1140.png 424w, /__u/substackcdn.com/image/fetch/$s_!8rSj!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa0440fe9-70bf-4b40-942a-51e326173c00_2560x1140.png 848w, /__u/substackcdn.com/image/fetch/$s_!8rSj!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa0440fe9-70bf-4b40-942a-51e326173c00_2560x1140.png 1272w, /__u/substackcdn.com/image/fetch/$s_!8rSj!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa0440fe9-70bf-4b40-942a-51e326173c00_2560x1140.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!8rSj!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa0440fe9-70bf-4b40-942a-51e326173c00_2560x1140.png" width="1456" height="648" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a0440fe9-70bf-4b40-942a-51e326173c00_2560x1140.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:648,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:356929,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:&quot;https://unsloth.ai/blog/vision&quot;,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!8rSj!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa0440fe9-70bf-4b40-942a-51e326173c00_2560x1140.png 424w, /__u/substackcdn.com/image/fetch/$s_!8rSj!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa0440fe9-70bf-4b40-942a-51e326173c00_2560x1140.png 848w, /__u/substackcdn.com/image/fetch/$s_!8rSj!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa0440fe9-70bf-4b40-942a-51e326173c00_2560x1140.png 1272w, /__u/substackcdn.com/image/fetch/$s_!8rSj!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa0440fe9-70bf-4b40-942a-51e326173c00_2560x1140.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://docs.unsloth.ai/&quot;,&quot;text&quot;:&quot;Visit our Documentation&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://docs.unsloth.ai/"><span>Visit our Documentation</span></a></p><h2><a href="https://unsloth.ai/blog/gradient">Gradient Accumulation Bug Fixes</a></h2><p>A while ago, we fixed a universal <a href="https://github.com/huggingface/trl/issues/2175">issue</a> in Gradient Accumulation that negatively impacted everyone's training, pre-training &amp; finetuning runs for sequence models like LLMs. <a href="https://github.com/unslothai/unsloth/releases/tag/October-2024">Unsloth's</a> Gradient Accumulation fix ensures training runs and loss calculations are performed accurately and correctly.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://unsloth.ai/blog/gradient" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!Kg1y!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F09576fa4-9140-4549-a69c-4f713d075c05_600x371.png 424w, /__u/substackcdn.com/image/fetch/$s_!Kg1y!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F09576fa4-9140-4549-a69c-4f713d075c05_600x371.png 848w, /__u/substackcdn.com/image/fetch/$s_!Kg1y!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F09576fa4-9140-4549-a69c-4f713d075c05_600x371.png 1272w, /__u/substackcdn.com/image/fetch/$s_!Kg1y!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F09576fa4-9140-4549-a69c-4f713d075c05_600x371.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!Kg1y!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F09576fa4-9140-4549-a69c-4f713d075c05_600x371.png" width="600" height="371" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/09576fa4-9140-4549-a69c-4f713d075c05_600x371.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:false,&quot;imageSize&quot;:&quot;normal&quot;,&quot;height&quot;:371,&quot;width&quot;:600,&quot;resizeWidth&quot;:600,&quot;bytes&quot;:38502,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:&quot;https://unsloth.ai/blog/gradient&quot;,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!Kg1y!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F09576fa4-9140-4549-a69c-4f713d075c05_600x371.png 424w, /__u/substackcdn.com/image/fetch/$s_!Kg1y!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F09576fa4-9140-4549-a69c-4f713d075c05_600x371.png 848w, /__u/substackcdn.com/image/fetch/$s_!Kg1y!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F09576fa4-9140-4549-a69c-4f713d075c05_600x371.png 1272w, /__u/substackcdn.com/image/fetch/$s_!Kg1y!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F09576fa4-9140-4549-a69c-4f713d075c05_600x371.png 1456w" sizes="100vw"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>The goal of gradient accumulation is to mimic full batch training with reduced VRAM usage. Gradient accumulation is also used in DDP and multi GPU setups, so this issue affected large scale training runs as well.</p><h2><a href="https://unsloth.ai/blog/qwen-coder">Qwen 2.5 + Coder</a></h2><p><a href="https://huggingface.co/collections/unsloth/qwen-25-coder-6732bc833ed65dd1964994d4">Qwen 2.5 Coder (32B)</a> released last week, matched GPT4o's performance on coding. Unsloth makes Qwen 2.5 finetuning 2x faster and use 60% less memory than Flash Attention 2 (FA2) + Hugging Face (HF).<br><br>Qwen Google Colab notebooks to finetune on a free Tesla T4:</p><ul><li><p><a href="https://colab.research.google.com/drive/18sN803sU23XuJV9Q8On2xgqHSer6-UZF?usp=sharing">Qwen 2.5 Coder (14B)</a></p></li><li><p><a href="https://colab.research.google.com/drive/1Kose-ucXO1IBaZq5BvbwWieuubP7hxvQ?usp=sharing">Qwen 2.5 (7B)</a></p></li></ul><h2>Thank you!</h2><p>Thank you for reading and your support. If you have any questions, please reach out to us on&nbsp;<a href="https://twitter.com/UnslothAI">Twitter (X)</a>&nbsp;or via&nbsp;<a href="mailto:support@unsloth.ai">support@unsloth.ai</a>.</p>]]></content:encoded></item><item><title><![CDATA[🦥 Unsloth Roadmap + YCombinator]]></title><description><![CDATA[We're excited to bring fine-tuning to an even larger audience & so you can focus on making the models you've always dreamed of, without the complexity.]]></description><link>https://unslothai.substack.com/p/unsloth-roadmap-ycombinator</link><guid isPermaLink="false">https://unslothai.substack.com/p/unsloth-roadmap-ycombinator</guid><dc:creator><![CDATA[Unsloth AI]]></dc:creator><pubDate>Thu, 05 Sep 2024 16:05:25 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!Dr36!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6090bbc8-e6d5-4739-b40d-59baf7dd2a4f_1920x1080.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>We've got a lot of new cool things coming to <a href="https://unsloth.ai/">Unsloth</a> slated for this year including Unsloth Studio, our long-awaited UI for fine-tuning models, and a new place where you can train, deploy &amp; run models. Feel free to join our <a href="https://unsloth.ai/waitlist">waitlist</a> for Unsloth Studio and our platform.<br><br>And a huge thank you to everyone who has downloaded our models on <a href="https://huggingface.co/unsloth">Hugging Face</a> as we're also celebrating our 2 million monthly downloads milestone! We're also excited to announce that Unsloth is now backed by <a href="https://www.ycombinator.com/companies/unsloth-ai">YCombinator</a>, and we will continue focusing on our open-source mission to make fine-tuning the best it can be!<br><br>Here's a run-through of what happened since our last update:</p><ul><li><p>Pip install Unsloth now works!</p></li><li><p>Multi GPU is now in beta with around 20 community members testing it!</p></li><li><p>You can now fine-tune with <a href="https://colab.research.google.com/drive/1VYkncZMfGFkeCEgN2IzbZIKEDkyQuJAS?usp=sharing">CSV / Excel files</a> with multiple columns</p></li><li><p>Microsoft's new Phi 3.5 <a href="https://colab.research.google.com/drive/1lN6hPQveB_mHSnTOYifygFcrO8C1bxq4?usp=sharing">mini</a> is now supported and we <a href="https://huggingface.co/unsloth/Phi-3.5-mini-instruct-bnb-4bit">Llamafied</a> it</p></li><li><p>DPO is now fixed. All chat templates now work and we fixed chat templates for Llama + Phi models</p></li><li><p>Please update your Unsloth Colab and Kaggle notebooks - all got updated with Torch 2.4</p></li></ul><h2>&#129445; Our Mission + Studio Update</h2><p>At Unsloth, our mission is to empower users to build the highest-quality models, the right way. We're deeply committed to advancing open-source development through collaborations with incredible teams like Hugging Face and Google, ensuring proper implementation of open models. We will continue to contribute to the development of open-source models, having previously addressed key bugs in models like <a href="https://unsloth.ai/blog/gemma-bugs">Google&#8217;s Gemma</a> and <a href="https://unsloth.ai/blog/llama3">Meta&#8217;s Llama</a>.<br><br><a href="https://unsloth.ai/waitlist">Unsloth Studio</a>, our first release coming soon, will encompass many highly requested features and will be able to run in Google Colab for free - or you can install it locally and use it 100% offline. Thanks to our community, we understand developer's need for integrating with existing workflows, so we're making it easier for users to incorporate their favorite open-source packages like <a href="https://github.com/janhq/jan">Jan,</a> <a href="https://github.com/ollama/ollama">Ollama</a>, or <a href="https://github.com/vllm-project/vllm">VLLM</a>, or even just exporting for inference.<br><br>And as demand for models like stable diffusion, multimodal models, and voice models grows across industries, we&#8217;re also focused on revolutionizing how these models are trained and being deployed today&#8212;just as we&#8217;ve already transformed the landscape for language model training.<br><br>Join our mission by subscribing to our <a href="https://unsloth.ai/waitlist">newsletter</a>or following us on social media to stay updated. P.S. We&#8217;re also hiring so if you&#8217;re eager to unsloth it, reach out to us at <a href="mailto:support@unsloth.ai?subject=Unsloth+It">support@unsloth.ai</a>&#8212;we&#8217;d love to hear from you!</p><h2>&#128142; The Platform</h2><p>Using math algorithms, low-level GPU programming (Triton, CUDA) we aim to innovate the LLM ecosystem through software, not hardware. With innovations like our <a href="https://unsloth.ai/blog/long-context">Unsloth Gradient Checkpointing algorithm</a>, which reduces training memory usage by more than 50%, we're constantly pushing the boundaries of AI. We're working on our new methodologies and algorithms for our platform which results in a 10%-40% lift in accuracy for models trained with the same controlled environments.<br><br>Our platform will have our exclusive 30x faster fine-tuning and faster inference offering along with easy peasy deployment setups plus much more. With our innovations, we aim to become the place for building custom models from scratch, offering the most accurate and accessible solutions for anyone&#8212;whether you&#8217;re a seasoned expert or just starting out.<br><br>We also understand the frustrations users experience when training &amp; deploying models and our aim is to for you to focus on creating the models you've always dreamed of, without the hassle. Say bye bye to dataset preparation, data &amp; chat template issues, and more! We also recognize the importance of deep customization, therefore, we're also introducing numerous components to enhance customizability without compromising accuracy or speed.<br><br>The beta version of the platform will be out by the end of this year and we'd love any feedback on the platform when we release it. In the meantime you can join our <a href="https://unsloth.ai/waitlist">waitlist</a>.<br><br>Thank you for reading! &#128522;<br></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://unsloth.ai/" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!Dr36!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6090bbc8-e6d5-4739-b40d-59baf7dd2a4f_1920x1080.png 424w, /__u/substackcdn.com/image/fetch/$s_!Dr36!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6090bbc8-e6d5-4739-b40d-59baf7dd2a4f_1920x1080.png 848w, /__u/substackcdn.com/image/fetch/$s_!Dr36!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6090bbc8-e6d5-4739-b40d-59baf7dd2a4f_1920x1080.png 1272w, /__u/substackcdn.com/image/fetch/$s_!Dr36!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6090bbc8-e6d5-4739-b40d-59baf7dd2a4f_1920x1080.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!Dr36!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6090bbc8-e6d5-4739-b40d-59baf7dd2a4f_1920x1080.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/6090bbc8-e6d5-4739-b40d-59baf7dd2a4f_1920x1080.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:93661,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:&quot;https://unsloth.ai/&quot;,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!Dr36!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6090bbc8-e6d5-4739-b40d-59baf7dd2a4f_1920x1080.png 424w, /__u/substackcdn.com/image/fetch/$s_!Dr36!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6090bbc8-e6d5-4739-b40d-59baf7dd2a4f_1920x1080.png 848w, /__u/substackcdn.com/image/fetch/$s_!Dr36!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6090bbc8-e6d5-4739-b40d-59baf7dd2a4f_1920x1080.png 1272w, /__u/substackcdn.com/image/fetch/$s_!Dr36!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6090bbc8-e6d5-4739-b40d-59baf7dd2a4f_1920x1080.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div>]]></content:encoded></item><item><title><![CDATA[Llama 3 is now on Unsloth 🦙]]></title><description><![CDATA[Llama 3 is now available to train! Meta's new models are the most capable open LLMs to date. Unsloth makes Llama 3 training 2x faster with 68% less memory. Read our Blog https://unsloth.ai/blog/llama3]]></description><link>https://unslothai.substack.com/p/llama-3-is-now-on-unsloth</link><guid isPermaLink="false">https://unslothai.substack.com/p/llama-3-is-now-on-unsloth</guid><pubDate>Wed, 24 Apr 2024 14:20:28 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/f5554120-338e-4257-b398-a6bab175c18c_1910x1000.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Meta's new Llama 3 models are the most capable open LLMs to date - outperforming many open models on industry standard benchmarks.<br><br>Unsloth makes <strong>Llama 3 (8B)</strong> model training 2x faster and use 63% less memory than Flash Attention 2 + Hugging Face. <strong>Llama 3 (70B)</strong> is 1.8x faster and uses 68% less VRAM.<br><br><strong>To train your own Llama 3 model for free,</strong> we uploaded a Google Colab notebook to finetune Llama 3 (8B):<a href="https://colab.research.google.com/drive/135ced7oHytdxu3N2DNe1Z0kqjyYIkDXp?usp=sharing"> Notebook</a>.<br><br>We also uploaded pre-quantized 4bit models for 4x faster downloading to our <a href="https://huggingface.co/unsloth">Hugging Face page</a>. On one A100 80GB GPU, Llama 3 (70B) with Unsloth can now fit 48K total tokens (8192 * bsz of 5) vs 7K tokens without Unsloth. That's 6x longer context lengths!<br><br>P.S. Don't forget to <a href="https://github.com/unslothai/unsloth">&#11088;Star us</a> on GitHub and join our <a href="https://discord.gg/u54VK8m8tk">Discord server</a> &#10084;&#65039;</p><p></p>]]></content:encoded></item><item><title><![CDATA[Hugging Face 🤗 + Unsloth AI collab ]]></title><description><![CDATA[Excited to share we did a collaboration on a blog post with Hugging Face! &#128149; Our latest Unsloth release also now supports Mistral, TinyLlama, GGUF conversion, DPO & more! Read: unsloth.ai/blog]]></description><link>https://unslothai.substack.com/p/hugging-face-unsloth-ai-collab</link><guid isPermaLink="false">https://unslothai.substack.com/p/hugging-face-unsloth-ai-collab</guid><dc:creator><![CDATA[Unsloth AI]]></dc:creator><pubDate>Fri, 19 Jan 2024 13:25:38 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!vYWb!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c4dfc78-cdae-4d19-b3e5-237a8fdbb0e1_1000x420.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://huggingface.co/blog/unsloth-trl" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!vYWb!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c4dfc78-cdae-4d19-b3e5-237a8fdbb0e1_1000x420.png 424w, /__u/substackcdn.com/image/fetch/$s_!vYWb!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c4dfc78-cdae-4d19-b3e5-237a8fdbb0e1_1000x420.png 848w, /__u/substackcdn.com/image/fetch/$s_!vYWb!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c4dfc78-cdae-4d19-b3e5-237a8fdbb0e1_1000x420.png 1272w, /__u/substackcdn.com/image/fetch/$s_!vYWb!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c4dfc78-cdae-4d19-b3e5-237a8fdbb0e1_1000x420.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!vYWb!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c4dfc78-cdae-4d19-b3e5-237a8fdbb0e1_1000x420.png" width="1000" height="420" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/7c4dfc78-cdae-4d19-b3e5-237a8fdbb0e1_1000x420.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:420,&quot;width&quot;:1000,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:177758,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:&quot;https://huggingface.co/blog/unsloth-trl&quot;,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!vYWb!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c4dfc78-cdae-4d19-b3e5-237a8fdbb0e1_1000x420.png 424w, /__u/substackcdn.com/image/fetch/$s_!vYWb!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c4dfc78-cdae-4d19-b3e5-237a8fdbb0e1_1000x420.png 848w, /__u/substackcdn.com/image/fetch/$s_!vYWb!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c4dfc78-cdae-4d19-b3e5-237a8fdbb0e1_1000x420.png 1272w, /__u/substackcdn.com/image/fetch/$s_!vYWb!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c4dfc78-cdae-4d19-b3e5-237a8fdbb0e1_1000x420.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://unsloth.ai/tinyllama-gguf" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!4lUi!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F529cce8c-c71c-4ac9-82f3-205599c6ee98_1280x670.png 424w, /__u/substackcdn.com/image/fetch/$s_!4lUi!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F529cce8c-c71c-4ac9-82f3-205599c6ee98_1280x670.png 848w, /__u/substackcdn.com/image/fetch/$s_!4lUi!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F529cce8c-c71c-4ac9-82f3-205599c6ee98_1280x670.png 1272w, /__u/substackcdn.com/image/fetch/$s_!4lUi!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F529cce8c-c71c-4ac9-82f3-205599c6ee98_1280x670.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!4lUi!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F529cce8c-c71c-4ac9-82f3-205599c6ee98_1280x670.png" width="1280" height="670" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/529cce8c-c71c-4ac9-82f3-205599c6ee98_1280x670.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:670,&quot;width&quot;:1280,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:42842,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:&quot;https://unsloth.ai/tinyllama-gguf&quot;,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!4lUi!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F529cce8c-c71c-4ac9-82f3-205599c6ee98_1280x670.png 424w, /__u/substackcdn.com/image/fetch/$s_!4lUi!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F529cce8c-c71c-4ac9-82f3-205599c6ee98_1280x670.png 848w, /__u/substackcdn.com/image/fetch/$s_!4lUi!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F529cce8c-c71c-4ac9-82f3-205599c6ee98_1280x670.png 1272w, /__u/substackcdn.com/image/fetch/$s_!4lUi!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F529cce8c-c71c-4ac9-82f3-205599c6ee98_1280x670.png 1456w" sizes="100vw"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p></p>]]></content:encoded></item><item><title><![CDATA[Introducing Unsloth.AI]]></title><description><![CDATA[Hey there! We know it's been a while, but we have launched our new open-source package called 'Unsloth'! It makes AI & LLM training 30x faster & you can try it for free now! Visit: unsloth.ai]]></description><link>https://unslothai.substack.com/p/introducing-unslothai</link><guid isPermaLink="false">https://unslothai.substack.com/p/introducing-unslothai</guid><dc:creator><![CDATA[Unsloth AI]]></dc:creator><pubDate>Fri, 01 Dec 2023 04:31:43 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!EHJj!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Feca6e04c-f7ba-447e-8e5c-77d0893f61f3_2000x1000.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="http://unsloth.ai/introducing" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!EHJj!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Feca6e04c-f7ba-447e-8e5c-77d0893f61f3_2000x1000.png 424w, /__u/substackcdn.com/image/fetch/$s_!EHJj!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Feca6e04c-f7ba-447e-8e5c-77d0893f61f3_2000x1000.png 848w, /__u/substackcdn.com/image/fetch/$s_!EHJj!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Feca6e04c-f7ba-447e-8e5c-77d0893f61f3_2000x1000.png 1272w, /__u/substackcdn.com/image/fetch/$s_!EHJj!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_webp, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Feca6e04c-f7ba-447e-8e5c-77d0893f61f3_2000x1000.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!EHJj!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Feca6e04c-f7ba-447e-8e5c-77d0893f61f3_2000x1000.png" width="1456" height="728" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/eca6e04c-f7ba-447e-8e5c-77d0893f61f3_2000x1000.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:728,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1528418,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:&quot;http://unsloth.ai/introducing&quot;,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!EHJj!, /__u/unslothai.substack.com/w_424, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Feca6e04c-f7ba-447e-8e5c-77d0893f61f3_2000x1000.png 424w, /__u/substackcdn.com/image/fetch/$s_!EHJj!, /__u/unslothai.substack.com/w_848, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Feca6e04c-f7ba-447e-8e5c-77d0893f61f3_2000x1000.png 848w, /__u/substackcdn.com/image/fetch/$s_!EHJj!, /__u/unslothai.substack.com/w_1272, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Feca6e04c-f7ba-447e-8e5c-77d0893f61f3_2000x1000.png 1272w, /__u/substackcdn.com/image/fetch/$s_!EHJj!, /__u/unslothai.substack.com/w_1456, /__u/unslothai.substack.com/c_limit, /__u/unslothai.substack.com/f_auto, /__u/unslothai.substack.com/q_auto:good, /__u/unslothai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Feca6e04c-f7ba-447e-8e5c-77d0893f61f3_2000x1000.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div>]]></content:encoded></item></channel></rss>