<script data-pm-proxy="intercept"></script><?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:itunes="http://www.itunes.com/dtds/podcast-1.0.dtd" xmlns:googleplay="http://www.google.com/schemas/play-podcasts/1.0"><channel><title><![CDATA[AI, Decoded]]></title><description><![CDATA[I’m learning how AI works and building projects with it. I write about what I find so you can understand it and use it too.]]></description><link>https://zahed.substack.com</link><image><url>https://substackcdn.com/image/fetch/$s_!qUYN!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff91ad143-e8a3-4a09-907e-3b2c375b712e_800x800.png</url><title>AI, Decoded</title><link>https://zahed.substack.com</link></image><generator>Substack</generator><lastBuildDate>Fri, 04 Sep 2026 11:33:55 GMT</lastBuildDate><atom:link href="/__u/zahed.substack.com/feed" rel="self" type="application/rss+xml"/><copyright><![CDATA[Zahed Al Saifi]]></copyright><language><![CDATA[en]]></language><webMaster><![CDATA[zahed@substack.com]]></webMaster><itunes:owner><itunes:email><![CDATA[zahed@substack.com]]></itunes:email><itunes:name><![CDATA[Zahed Al Saifi]]></itunes:name></itunes:owner><itunes:author><![CDATA[Zahed Al Saifi]]></itunes:author><googleplay:owner><![CDATA[zahed@substack.com]]></googleplay:owner><googleplay:email><![CDATA[zahed@substack.com]]></googleplay:email><googleplay:author><![CDATA[Zahed Al Saifi]]></googleplay:author><itunes:block><![CDATA[Yes]]></itunes:block><item><title><![CDATA[Everyone's Asking the Wrong Wrapper Question]]></title><description><![CDATA[Nearly every AI startup rents its intelligence. Here's how to tell which ones still have a real moat.]]></description><link>https://zahed.substack.com/p/what-to-ask-startups</link><guid isPermaLink="false">https://zahed.substack.com/p/what-to-ask-startups</guid><dc:creator><![CDATA[Zahed Al Saifi]]></dc:creator><pubDate>Wed, 05 Aug 2026 18:48:34 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!B_4A!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13d41b3c-cd51-423b-a4c3-b5f9e768ae85_2531x1424.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!B_4A!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13d41b3c-cd51-423b-a4c3-b5f9e768ae85_2531x1424.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!B_4A!, /__u/zahed.substack.com/w_424, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13d41b3c-cd51-423b-a4c3-b5f9e768ae85_2531x1424.png 424w, /__u/substackcdn.com/image/fetch/$s_!B_4A!, /__u/zahed.substack.com/w_848, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13d41b3c-cd51-423b-a4c3-b5f9e768ae85_2531x1424.png 848w, /__u/substackcdn.com/image/fetch/$s_!B_4A!, /__u/zahed.substack.com/w_1272, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13d41b3c-cd51-423b-a4c3-b5f9e768ae85_2531x1424.png 1272w, /__u/substackcdn.com/image/fetch/$s_!B_4A!, /__u/zahed.substack.com/w_1456, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13d41b3c-cd51-423b-a4c3-b5f9e768ae85_2531x1424.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!B_4A!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13d41b3c-cd51-423b-a4c3-b5f9e768ae85_2531x1424.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/13d41b3c-cd51-423b-a4c3-b5f9e768ae85_2531x1424.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!B_4A!, /__u/zahed.substack.com/w_424, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13d41b3c-cd51-423b-a4c3-b5f9e768ae85_2531x1424.png 424w, /__u/substackcdn.com/image/fetch/$s_!B_4A!, /__u/zahed.substack.com/w_848, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13d41b3c-cd51-423b-a4c3-b5f9e768ae85_2531x1424.png 848w, /__u/substackcdn.com/image/fetch/$s_!B_4A!, /__u/zahed.substack.com/w_1272, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13d41b3c-cd51-423b-a4c3-b5f9e768ae85_2531x1424.png 1272w, /__u/substackcdn.com/image/fetch/$s_!B_4A!, /__u/zahed.substack.com/w_1456, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F13d41b3c-cd51-423b-a4c3-b5f9e768ae85_2531x1424.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Every time I open LinkedIn, Instagram, or X, I see the same headline: &#8220;AI Startup X raises $30 million Series A.&#8221; This isn&#8217;t just feed noise. AI startups captured more than half of all global venture capital dollars in 2025, the first time any single sector has done that. That made me wonder how much of that capital funds real technical differentiation versus a hot buzzword and a compelling story. Before writing a check, every investor should ask: What happens the day OpenAI, Anthropic, or Google ships your product for free?</p><p>Before asking this question, investors should understand the difference between a wrapper and a moat. Both words get thrown around in AI pitches and are rarely used correctly. Strictly speaking, &#8220;wrapper&#8221; describes a layer of a product, not the whole company. It refers specifically to the AI capability, which belongs entirely to the LLM provider, such as Anthropic. The startup formats its users&#8217; requests and sends them to a rented model via an Application Programming Interface, or API, then formats the response it gets back. Think of an API as a waiter taking an order: the startup packages the customer&#8217;s request, hands it to the kitchen (the LLM vendor), and carries the dish back to the table. They don&#8217;t own the kitchen.</p><div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;391e2b9c-2538-4146-bc3e-9295f6554738&quot;,&quot;duration&quot;:null}"></div><p>By this definition, almost every AI startup is a wrapper, since almost none of them train their own model. That&#8217;s normal, and not, on its own, disqualifying. The term isn&#8217;t useless just because it&#8217;s universal; it just means the interesting question is never whether a startup is a wrapper, but what else it is. A moat, on the other hand, is what makes a startup hard to replicate at some <em><span>other</span></em> layer of the product. You have a moat when a competitor cannot rebuild the entire product, even with access to that same rented AI model, without the data, integrations, infrastructure, and relationships the startup has built around it.</p><h2><strong><span>Signal 1: Is the Startup Building a Cumulative Moat?</span></strong></h2><p>Given that nearly every AI startup is a wrapper at the AI layer, the real work for an investor is figuring out whether there&#8217;s a moat somewhere else. First, look for a product that gets smarter with every use. If you call GPT-5 a million times, it doesn&#8217;t make your product smarter than a competitor&#8217;s, since OpenAI improves that model for every customer at once. For the product to actually get smarter, the improvements have to be stored somewhere the company owns. There are three ways a startup can do that: fine-tuning on proprietary data, retrieval-based knowledge accumulation, and feedback loops.</p><h3>Fine-Tuning on Proprietary Data</h3><p>Fine-tuning on proprietary data means periodically retraining a model on accumulated, company-owned interaction data so that it gets better at the specific task it&#8217;s meant to do. The process begins with an already-trained base model, like Gemini. The startup feeds a proprietary, expert-labeled dataset to the model, adjusting its parameters to master the specific task.</p><p>Say a startup builds an AI tool for reviewing insurance claims. Every claim it processes, along with the human adjuster&#8217;s final decision, becomes a new training example. Over thousands of claims, the model gets better at spotting the specific patterns that matter to that insurer, in a way a generic model never would. If the dataset is something only the startup has access to, such as years of real customer interactions, regulated-industry transaction data, or outcomes from real cases handled, then this is a moat. Even if a competitor copies the fine-tuning process, they can&#8217;t get the same data.</p><p>Crucially, fine-tuning doesn&#8217;t remove a startup&#8217;s vendor dependency. Startups usually still pay someone, either the vendor or a cloud provider, to actually run the fine-tuned model. A startup can be doing real, proprietary fine-tuning work while remaining dependent on the vendor&#8217;s underlying infrastructure. Neither of these facts is evidence that the startup lacks a moat.</p><h3>Retrieval-Augmented Generation</h3><p>A second way startups build this kind of moat is retrieval-augmented generation, or RAG. Unlike fine-tuning, retrieval leaves the model untouched and instead focuses on growing the database the model uses to answer questions. In practice, the system continuously logs user interactions and outcomes. Each time a new user has a question, the system searches the database for the most relevant matches and hands them to the AI as context before it responds.</p><p>Let&#8217;s take the example of a startup that sells AI customer support for e-commerce companies. On day one, the AI answers a ticket using only general knowledge, since it doesn&#8217;t yet know anything specific about that company. It then stores the entire resolution context, including what happened, whether a refund was issued, and the applicable policy. By ticket fifty thousand, a similar situation comes in, and now the AI retrieves actual past resolutions from that exact company, including edge cases nobody wrote into an official policy document. The answer gets better, not because the AI got smarter, but because the archive it&#8217;s pulling from got deeper. This is the moat, since the archive is built entirely from proprietary interactions competitors don&#8217;t have.</p><h3>Proprietary Feedback Loops</h3><p>Finally, proprietary feedback loops create defensibility through continuous quality improvement. Take the same e-commerce example: if the AI answers a support ticket, a human agent can review it and either approve, edit, or override it. That correction is itself a signal, and over thousands of tickets, patterns emerge showing where the AI tends to get things wrong. The startup can use these corrections in three ways:</p><ul><li><p>Fine-tuning data: Retraining the model on what went wrong versus the human correction.</p></li><li><p>Retrieval context: Storing the corrected answer in the knowledge base so future queries pull the right version.</p></li><li><p>Prompt calibration: Directly adjusting the system prompt instructions based on recurring patterns, without retraining.</p></li></ul><p>This is a moat because this company&#8217;s users generate the correction data. A competitor can&#8217;t buy or scrape that.</p><h2><strong><span>Signal 2: How Hard Is It to Leave?</span></strong></h2><p>Start by checking integration depth: how difficult it would be for an existing customer to stop using the startup&#8217;s product and switch to another one. If a product offers no proprietary data and no deep integration, the customer can easily switch to another wrapper. However, if the product is deeply integrated into a customer&#8217;s existing systems, such as their CRM, single sign-on, or approval workflows, and has historical data or team habits built around it, switching becomes much harder. The AI itself might still be entirely rented. The switching cost comes from somewhere else: the customer&#8217;s data, workflows, and habits, not the intelligence layer at all.</p><h2><strong><span>Signal 3: </span></strong>Is It Built for One Industry, or All of Them?</h2><p>A natural extension of workflow lock-in is vertical depth: whether the startup is built deeply for one specific industry rather than generically for everyone. A generalist AI tool, one that could technically serve any company in any industry, is much easier for a well-resourced competitor, or the model provider itself, to replicate than a product built around one industry&#8217;s specific workflows, data, and regulations. This is also one of the most common things investors are currently pushing founders on: a startup that says &#8220;we&#8217;re an AI tool for X&#8221; is a stronger claim than one that says &#8220;we&#8217;re an AI tool for everyone.&#8221;</p><h2>Case Study: How Replit Proves the Framework</h2><p>Now let&#8217;s test this framework against an extremely successful AI startup: Replit. For anyone unfamiliar, Replit is an AI-powered development platform where you describe an app in plain English and watch it get built, debugged, and deployed automatically, all inside the browser, with no local setup. It&#8217;s grown fast: in March 2026, Replit raised a $400 million round at a $9 billion valuation, tripling its value in just six months, and now serves over 40 million users. Replit doesn&#8217;t have its own frontier LLM, so what&#8217;s so special about it?</p><p>Replit runs a model-agnostic routing strategy across Claude, Gemini, and GPT, directing each task to the model based on cost and complexity. At this reasoning layer, Replit is renting intelligence, making it a wrapper by definition. Yet Replit still has a real moat, built on two things.</p><p>First, it owns small proprietary models for high-frequency micro-tasks. Inline completions run on distilled internal models, smaller models trained to mimic a larger one&#8217;s behavior at a fraction of the cost. This directly protects their margins: they&#8217;re not paying full API rates on every single keystroke, only on the reasoning calls that actually need it.</p><p>Second, Replit owns the non-AI infrastructure around the model: a browser-based cloud IDE, real-time collaboration, hosting, databases, and one-click deployment. If a competitor gained access to the same LLMs tomorrow, they would still have to rebuild an entire cloud development ecosystem from scratch.</p><p>Replit is a wrapper wrapped in a real product. The AI is rented, but the thing customers are actually locked into, their whole coding environment, is owned.</p><h2>The Real Diligence Question</h2><p>The sharper question isn&#8217;t &#8220;is this a wrapper.&#8221; Almost nothing passes that test. Nearly every AI startup rents its intelligence from OpenAI, Anthropic, or Google. The better question has two parts: which layers of this company does it actually own, and which does it rent? And is the owned layer something a customer would pay for on its own, even if the AI itself became a commodity tomorrow? Replit rents the reasoning and owns the environment. The next startup you look at might rent everything and own nothing, or it might own a dataset no competitor can touch. Either way, that&#8217;s the diligence question that actually tells you something. Not &#8220;do they have AI,&#8221; but &#8220;what happens the day the AI stops being the interesting part.&#8221;</p><p>If you're an investor who's had this conversation with a founder, I'd like to hear how it went.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://zahed.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="/__u/zahed.substack.com/subscribe"><span>Subscribe now</span></a></p><p></p>]]></content:encoded></item><item><title><![CDATA[Power Plants for Math]]></title><description><![CDATA[Inside the colossal factories manufacturing the physical reality of AI.]]></description><link>https://zahed.substack.com/p/power-plants-for-math</link><guid isPermaLink="false">https://zahed.substack.com/p/power-plants-for-math</guid><dc:creator><![CDATA[Zahed Al Saifi]]></dc:creator><pubDate>Sat, 16 May 2026 01:09:44 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!WZ8k!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffb8339ee-e92c-4d53-ab1f-0ff56631b3dd_2549x1434.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!WZ8k!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffb8339ee-e92c-4d53-ab1f-0ff56631b3dd_2549x1434.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!WZ8k!, /__u/zahed.substack.com/w_424, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffb8339ee-e92c-4d53-ab1f-0ff56631b3dd_2549x1434.png 424w, /__u/substackcdn.com/image/fetch/$s_!WZ8k!, /__u/zahed.substack.com/w_848, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffb8339ee-e92c-4d53-ab1f-0ff56631b3dd_2549x1434.png 848w, /__u/substackcdn.com/image/fetch/$s_!WZ8k!, /__u/zahed.substack.com/w_1272, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffb8339ee-e92c-4d53-ab1f-0ff56631b3dd_2549x1434.png 1272w, /__u/substackcdn.com/image/fetch/$s_!WZ8k!, /__u/zahed.substack.com/w_1456, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffb8339ee-e92c-4d53-ab1f-0ff56631b3dd_2549x1434.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!WZ8k!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffb8339ee-e92c-4d53-ab1f-0ff56631b3dd_2549x1434.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/fb8339ee-e92c-4d53-ab1f-0ff56631b3dd_2549x1434.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!WZ8k!, /__u/zahed.substack.com/w_424, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffb8339ee-e92c-4d53-ab1f-0ff56631b3dd_2549x1434.png 424w, /__u/substackcdn.com/image/fetch/$s_!WZ8k!, /__u/zahed.substack.com/w_848, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffb8339ee-e92c-4d53-ab1f-0ff56631b3dd_2549x1434.png 848w, /__u/substackcdn.com/image/fetch/$s_!WZ8k!, /__u/zahed.substack.com/w_1272, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffb8339ee-e92c-4d53-ab1f-0ff56631b3dd_2549x1434.png 1272w, /__u/substackcdn.com/image/fetch/$s_!WZ8k!, /__u/zahed.substack.com/w_1456, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffb8339ee-e92c-4d53-ab1f-0ff56631b3dd_2549x1434.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption"><em>The new architecture of intelligence.</em></figcaption></figure></div><p>In this final post, I want to focus on a rarely discussed but fundamental aspect of AI: the physical infrastructure behind LLMs. It&#8217;s what allows us to create videos of dancing politicians or the thing your manager wants when he says <em>&#8220;we need to go agentic&#8221;</em> for the tenth time this week.</p><div><hr></div><h2><strong>The $5.2 Trillion Shovel</strong></h2><p>By 2030, global investment in AI-ready data centers is projected to reach $5.2 trillion, according to McKinsey, as the world races to build the compute infrastructure required to power large language models. This is unprecedented. To put this in perspective, AI-related capital expenditures contributed roughly 1 percentage point to U.S. GDP growth in the first half of 2025.</p><p>To understand how massive that is, 1 percentage point of GDP is nearly double what the entire U.S. spends on coffee every year, or roughly half of the entire U.S. Department of Education&#8217;s budget. This has already surpassed the internet boom of the late 1990s, when IT investment peaked at about 0.5% of GDP growth. We are no longer just manipulating data. We have moved into building massive AI Factories to manufacture intelligence at an enormous scale.</p><h2><strong>The 1% Real Estate Crisis</strong></h2><p>I recently watched <em>Eddington</em>, the latest movie from Ari Aster starring Joaquin Phoenix. In the film, a giant, looming data center sits at the edge of a New Mexico town like a silent character. The film uses it as a metaphor for our brewing distrust. The data center is the ultimate winner while the townspeople descend into paranoia.</p><p>Sinister or not, what I realized watching that movie is that most people don&#8217;t realize that a data center is simply the physical home of the internet. For AI, these aren&#8217;t just warehouses for files. They are hyper-specialized power plants for math. However, we are currently facing a big problem. Despite a surge in construction, vacancy rates in primary markets have reached a record low of 1%. Over 60% of new builds are pre-leased years in advance. Access to space and power is now the #1 barrier to AI expansion.</p><h2><strong>Architects of Logic, Builders of Silicon</strong></h2><p>This lack of real estate is only one part of the problem. To understand the rest of the market, we must distinguish between the Architects and the Builders.</p><p><em>NVIDIA</em> is a <em>fabless</em> company. This means they are the architects who design the complex blueprints for chips, but they don&#8217;t actually own the machines to build them. For that, the entire world relies on a <em>foundry</em>. A <em>foundry</em> is essentially an outsourced high-tech factory.</p><p><em>Google</em> is also moving in this direction with its Custom Silicon strategy. By designing their own specialized chips, like the <em>TPU</em>, they avoid having to rely on <em>NVIDIA</em> and can improve efficiency. But even <em>Google</em> is <em>fabless</em>. No matter who wins the design war, everyone must wait in line for the same few <em>foundries</em> to physically manufacture the chips.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://zahed.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Enjoyed this article? Subscribe for more.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><h2><strong>The Six Champions of the AI Stack</strong></h2><p>The AI stack is complex, so I selected one champion from each layer. These are the companies that own the essential parts of the industry.</p><h3><strong>The Manufacturing Edge</strong></h3><p><strong>ASML: </strong><em>Lithography</em> is the process of drawing with light. <em>ASML</em> uses massive lasers to etch microscopic circuit patterns onto silicon wafers. It is the only company on Earth that can do this at the scale required for AI.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!vQpy!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff42c871b-5dd6-4483-8f8d-041f832e4085_2549x1434.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!vQpy!, /__u/zahed.substack.com/w_424, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff42c871b-5dd6-4483-8f8d-041f832e4085_2549x1434.png 424w, /__u/substackcdn.com/image/fetch/$s_!vQpy!, /__u/zahed.substack.com/w_848, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff42c871b-5dd6-4483-8f8d-041f832e4085_2549x1434.png 848w, /__u/substackcdn.com/image/fetch/$s_!vQpy!, /__u/zahed.substack.com/w_1272, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff42c871b-5dd6-4483-8f8d-041f832e4085_2549x1434.png 1272w, /__u/substackcdn.com/image/fetch/$s_!vQpy!, /__u/zahed.substack.com/w_1456, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff42c871b-5dd6-4483-8f8d-041f832e4085_2549x1434.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!vQpy!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff42c871b-5dd6-4483-8f8d-041f832e4085_2549x1434.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/f42c871b-5dd6-4483-8f8d-041f832e4085_2549x1434.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!vQpy!, /__u/zahed.substack.com/w_424, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff42c871b-5dd6-4483-8f8d-041f832e4085_2549x1434.png 424w, /__u/substackcdn.com/image/fetch/$s_!vQpy!, /__u/zahed.substack.com/w_848, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff42c871b-5dd6-4483-8f8d-041f832e4085_2549x1434.png 848w, /__u/substackcdn.com/image/fetch/$s_!vQpy!, /__u/zahed.substack.com/w_1272, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff42c871b-5dd6-4483-8f8d-041f832e4085_2549x1434.png 1272w, /__u/substackcdn.com/image/fetch/$s_!vQpy!, /__u/zahed.substack.com/w_1456, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff42c871b-5dd6-4483-8f8d-041f832e4085_2549x1434.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption"><em>The most complex city map in the world and it fits on the tip of your finger.</em></figcaption></figure></div><h3><strong>The Master Builder</strong></h3><p><strong>TSMC: </strong>It builds over 90% of the world&#8217;s high-end AI chips. It turns <em>NVIDIA</em> and <em>Google&#8217;s</em> blueprints into physical reality.</p><h3><strong>The Memory King</strong></h3><p><strong>SK Hynix: </strong>AI chips need high-bandwidth memory, which is like a high-speed fuel line for data. <em>SK Hynix</em> is currently the lead partner providing this fuel for <em>NVIDIA&#8217;s </em>next-generation platforms.</p><h3><strong>The Cooling Leader</strong></h3><p><strong>Vertiv: </strong>Air cooling is no longer enough for chips pulling this much power. <em>Vertiv</em> specializes in liquid cooling, essentially a radiator system that keeps the hardware from melting.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!9GMv!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa36e18a3-e569-4405-b247-133d7142f4c2_2549x1434.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!9GMv!, /__u/zahed.substack.com/w_424, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa36e18a3-e569-4405-b247-133d7142f4c2_2549x1434.png 424w, /__u/substackcdn.com/image/fetch/$s_!9GMv!, /__u/zahed.substack.com/w_848, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa36e18a3-e569-4405-b247-133d7142f4c2_2549x1434.png 848w, /__u/substackcdn.com/image/fetch/$s_!9GMv!, /__u/zahed.substack.com/w_1272, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa36e18a3-e569-4405-b247-133d7142f4c2_2549x1434.png 1272w, /__u/substackcdn.com/image/fetch/$s_!9GMv!, /__u/zahed.substack.com/w_1456, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa36e18a3-e569-4405-b247-133d7142f4c2_2549x1434.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!9GMv!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa36e18a3-e569-4405-b247-133d7142f4c2_2549x1434.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a36e18a3-e569-4405-b247-133d7142f4c2_2549x1434.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!9GMv!, /__u/zahed.substack.com/w_424, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa36e18a3-e569-4405-b247-133d7142f4c2_2549x1434.png 424w, /__u/substackcdn.com/image/fetch/$s_!9GMv!, /__u/zahed.substack.com/w_848, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa36e18a3-e569-4405-b247-133d7142f4c2_2549x1434.png 848w, /__u/substackcdn.com/image/fetch/$s_!9GMv!, /__u/zahed.substack.com/w_1272, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa36e18a3-e569-4405-b247-133d7142f4c2_2549x1434.png 1272w, /__u/substackcdn.com/image/fetch/$s_!9GMv!, /__u/zahed.substack.com/w_1456, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa36e18a3-e569-4405-b247-133d7142f4c2_2549x1434.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption"><em>Liquid cooling for the most expensive real estate on the planet.</em></figcaption></figure></div><h3><strong>The Energy Frontier</strong></h3><p><strong>Constellation Energy: </strong>It is the power plant of the internet. <em>Constellation Energy </em>recently signed a 20-year deal to restart the Three Mile Island reactor specifically to provide reliable and abundant nuclear power for <em>Microsoft</em>.</p><h3><strong>The Data Conductor</strong></h3><p><strong>Broadcom: </strong>As <em>clusters</em>, which are networks of thousands of <em>GPUs</em> working together, grow larger, moving data between them becomes the bottleneck. <em>GPUs</em> are the specialized calculators that do the AI math, but they are useless if they can&#8217;t talk to each other. <em>Broadcom</em> builds the high-speed plumbing that keeps data moving between servers at lightning speed.</p><div><hr></div><h2><strong>The Map is Ready: Moving to Execution</strong></h2><p>We analyzed the LLM&#8217;s logic, compared it to the incredible efficiency of the human brain, and mapped the massive physical infrastructure required to run it. We know the architects, the builders, and the power sources.</p><p>The blueprint is set. It&#8217;s time to move from theory to execution and start building.</p><div class="captioned-button-wrap" data-attrs="{&quot;url&quot;:&quot;https://zahed.substack.com/p/power-plants-for-math?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="CaptionedButtonToDOM"><div class="preamble"><p class="cta-caption">Thanks for reading my Substack! This post is public so feel free to share it.</p></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://zahed.substack.com/p/power-plants-for-math?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="ButtonCreateButton"><a class="button primary" href="/__u/zahed.substack.com/p/power-plants-for-math?utm_source=substack&amp;utm_medium=email&amp;utm_content=share&amp;action=share"><span>Share</span></a></p></div>]]></content:encoded></item><item><title><![CDATA[AI Has No Gut Feeling]]></title><description><![CDATA[Why a trillion-parameter model still can&#8217;t beat your 20-watt brain.]]></description><link>https://zahed.substack.com/p/ai-has-no-gut-feeling</link><guid isPermaLink="false">https://zahed.substack.com/p/ai-has-no-gut-feeling</guid><dc:creator><![CDATA[Zahed Al Saifi]]></dc:creator><pubDate>Wed, 06 May 2026 12:52:06 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!KwX_!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5e3902db-1192-4943-9056-51a767518df4_2549x1434.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>In my previous post, we observed the mechanical response that occurs within an LLM when we ask it a question. Next, let&#8217;s compare the LLM to the original gold standard: the human brain.</p><div><hr></div><h2><strong>The 20-Watt Miracle</strong></h2><p>The brain is composed of approximately 86 billion neurons. These are living cells that are powered by electricity and chemicals, such as dopamine and serotonin, to transmit information. In contrast, an LLM relies on <em>parameters</em>, which are numerical strengths of connections stored on silicon chips.</p><p>In terms of efficiency, the gap is massive. The brain needs approximately 20 watts to function, roughly the power used by a single dim light bulb, at all times. By contrast, just training a top-tier AI model can require 20&#8211;25 megawatts of power sustained over about three months. That is roughly equivalent to powering two to three Empire State Buildings non-stop for the entire duration.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!UiVI!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F36eb1cab-7e4a-4d87-9250-dac2f6d21512_2549x1434.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!UiVI!, /__u/zahed.substack.com/w_424, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F36eb1cab-7e4a-4d87-9250-dac2f6d21512_2549x1434.png 424w, /__u/substackcdn.com/image/fetch/$s_!UiVI!, /__u/zahed.substack.com/w_848, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F36eb1cab-7e4a-4d87-9250-dac2f6d21512_2549x1434.png 848w, /__u/substackcdn.com/image/fetch/$s_!UiVI!, /__u/zahed.substack.com/w_1272, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F36eb1cab-7e4a-4d87-9250-dac2f6d21512_2549x1434.png 1272w, /__u/substackcdn.com/image/fetch/$s_!UiVI!, /__u/zahed.substack.com/w_1456, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F36eb1cab-7e4a-4d87-9250-dac2f6d21512_2549x1434.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!UiVI!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F36eb1cab-7e4a-4d87-9250-dac2f6d21512_2549x1434.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/36eb1cab-7e4a-4d87-9250-dac2f6d21512_2549x1434.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!UiVI!, /__u/zahed.substack.com/w_424, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F36eb1cab-7e4a-4d87-9250-dac2f6d21512_2549x1434.png 424w, /__u/substackcdn.com/image/fetch/$s_!UiVI!, /__u/zahed.substack.com/w_848, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F36eb1cab-7e4a-4d87-9250-dac2f6d21512_2549x1434.png 848w, /__u/substackcdn.com/image/fetch/$s_!UiVI!, /__u/zahed.substack.com/w_1272, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F36eb1cab-7e4a-4d87-9250-dac2f6d21512_2549x1434.png 1272w, /__u/substackcdn.com/image/fetch/$s_!UiVI!, /__u/zahed.substack.com/w_1456, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F36eb1cab-7e4a-4d87-9250-dac2f6d21512_2549x1434.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption"><em>Our brain thrives on 20 watts, while a trillion-parameter model requires the energy of a few skyscrapers.</em></figcaption></figure></div><div class="captioned-button-wrap" data-attrs="{&quot;url&quot;:&quot;https://zahed.substack.com/p/ai-has-no-gut-feeling?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="CaptionedButtonToDOM"><div class="preamble"><p class="cta-caption">Thanks for reading my Substack! This post is public so feel free to share it.</p></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://zahed.substack.com/p/ai-has-no-gut-feeling?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="ButtonCreateButton"><a class="button primary" href="/__u/zahed.substack.com/p/ai-has-no-gut-feeling?utm_source=substack&amp;utm_medium=email&amp;utm_content=share&amp;action=share"><span>Share</span></a></p></div><h2><strong>Why Your Brain Never Stops Building Itself</strong></h2><blockquote><p>The human brain is a master one-time learner. If we see a photo of a laptop once, our brains can rewire themselves through <em>neuroplasticity</em>, so we know what a laptop is forever. In contrast, an LLM must be shown millions of images and billions of sentences to learn patterns.</p></blockquote><p>When an LLM is trained, its weights&#8212;the numerical strengths that dictate its logic&#8212;are frozen into a static snapshot. Humans, however, are adaptive even in complex settings. For instance, in the context of investing, we can listen to Trump introducing new tariffs and instantly adjust our strategy based on intuition. By contrast, an LLM&#8217;s core brain remains locked in the past. It cannot learn a new fundamental truth about the world once its training is complete.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!KwX_!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5e3902db-1192-4943-9056-51a767518df4_2549x1434.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!KwX_!, /__u/zahed.substack.com/w_424, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5e3902db-1192-4943-9056-51a767518df4_2549x1434.png 424w, /__u/substackcdn.com/image/fetch/$s_!KwX_!, /__u/zahed.substack.com/w_848, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5e3902db-1192-4943-9056-51a767518df4_2549x1434.png 848w, /__u/substackcdn.com/image/fetch/$s_!KwX_!, /__u/zahed.substack.com/w_1272, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5e3902db-1192-4943-9056-51a767518df4_2549x1434.png 1272w, /__u/substackcdn.com/image/fetch/$s_!KwX_!, /__u/zahed.substack.com/w_1456, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5e3902db-1192-4943-9056-51a767518df4_2549x1434.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!KwX_!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5e3902db-1192-4943-9056-51a767518df4_2549x1434.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/5e3902db-1192-4943-9056-51a767518df4_2549x1434.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!KwX_!, /__u/zahed.substack.com/w_424, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5e3902db-1192-4943-9056-51a767518df4_2549x1434.png 424w, /__u/substackcdn.com/image/fetch/$s_!KwX_!, /__u/zahed.substack.com/w_848, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5e3902db-1192-4943-9056-51a767518df4_2549x1434.png 848w, /__u/substackcdn.com/image/fetch/$s_!KwX_!, /__u/zahed.substack.com/w_1272, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5e3902db-1192-4943-9056-51a767518df4_2549x1434.png 1272w, /__u/substackcdn.com/image/fetch/$s_!KwX_!, /__u/zahed.substack.com/w_1456, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5e3902db-1192-4943-9056-51a767518df4_2549x1434.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption"><em>Your brain rewires itself in seconds while the LLM stays frozen until its next update.</em></figcaption></figure></div><p>You might ask: <em>&#8220;But can&#8217;t I just feed it live tweets and speeches?&#8221;</em></p><p>Yes, but when the LLM processes live signals, we are handing it a temporary cheat sheet of current events. So, while it can follow the instructions on that sheet, it cannot update its underlying worldview based on the new information.</p><h2><strong>Probability is Not Intuition</strong></h2><p>In psychology, humans think in terms of two distinct systems: System 1 and System 2.</p><ul><li><p>System 1 is fast, instinctive, and emotional. This is when we tell ourselves, <em>&#8220;Bitcoin is going up, I need to buy now!&#8221; </em>when Bitcoin hits 100k.</p></li><li><p>System 2 is slow, analytical, and logical. This is when we take a moment and calculate the actual risk.</p></li></ul><p>As humans, we make decisions with System 1 and perhaps later justify them with System 2. For LLMs, there is no intention, only prediction. They operate by calculating the statistical likelihood of what comes next. When an AI picks <em>Buy</em>, it isn&#8217;t because it feels confident; it&#8217;s because <em>Buy</em> is mathematically the most likely word consistent with the data.</p><h2><strong>The Simulation of Experience</strong></h2><p>The brain knows the world through experience. It understands <em>Risk</em> because it has felt the tightness in the chest after losing money playing poker. It knows <em>Success</em> because it has felt the rush from its football team winning the Champions League. An LLM, by comparison, knows these things through association. To an LLM, <em>Risk</em> is just a token that frequently sits near the word <em>Loss</em> on its mathematical map. It is a simulation of meaning, not the experience of it.</p><div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;61be41df-d7bf-4a15-a423-ac6774a7f657&quot;,&quot;duration&quot;:null}"></div><h2><strong>Predicting the Future vs. Understanding the Present</strong></h2><p>Let&#8217;s consider an example: if an LLM says <em>&#8220;Buy NVIDIA&#8221; </em>and a human says <em>&#8220;Buy NVIDIA,&#8221;</em> and then the stock goes up, does the method matter?</p><p>As of today, the answer is yes, because of the gap between Correlation and Causality.</p><p>An LLM is a master of correlation: <em>When Politician X says Y, Stock Z usually goes up</em>. However, it lacks a world model to verify why one thing causes another. Humans, on the other hand, use context and acquired logic to pressure-test those links.</p><p>Having said that, we are already seeing the birth of Causal AI, which is designed to move beyond simple pattern matching and understand why things happen. While this work is advancing in research labs, we are not yet at the point where an LLM can evaluate qualitative factors like a CEO&#8217;s personality with the same judgment and nuance as an experienced investor.</p><div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;8d670b97-866e-4ec3-bb7a-62ee70f2734e&quot;,&quot;duration&quot;:null}"></div><div><hr></div><h2><strong>The Infrastructure of the Trillion-Parameter Era</strong></h2><p>In my next post, we&#8217;ll look at the physical infrastructure and key companies behind these models to see exactly who is driving this revolution.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://zahed.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Enjoyed this article? Subscribe for more.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[The Assembly Line of AI Logic]]></title><description><![CDATA[How high-speed math turns human language into a multidimensional map of meaning.]]></description><link>https://zahed.substack.com/p/the-assembly-line-of-ai-logic</link><guid isPermaLink="false">https://zahed.substack.com/p/the-assembly-line-of-ai-logic</guid><dc:creator><![CDATA[Zahed Al Saifi]]></dc:creator><pubDate>Mon, 27 Apr 2026 12:02:21 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!r7My!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b20cbc9-5657-4ab2-bef1-9b387f6a3e5b_2549x1434.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Previously, we saw how LLMs use <em>neural networks</em> and training loops to simulate human logic. Now, let&#8217;s see what happens inside the model when we ask a question.</p><div><hr></div><h2><strong>Our Words Are Just GPS Coordinates</strong></h2><p>LLMs do not read words the way humans do. Instead, they calculate statistical relationships within numerical patterns.</p><p>To do this, our language is converted into <em>vectors. Vectors are </em>arrays of numbers that show each word&#8217;s position in a huge, mathematical space. This lets the LLM compare many words and generate logical text.</p><p>There are two steps involved in this transformation process:</p><h3><strong>Step 1: Tokenization - Breaking the World into Bricks</strong></h3><p>First, the LLM splits our sentence into <em>tokens</em>. The computer cannot process the word <em>NVIDIA</em> as a whole, so it often breaks it into parts, like <em>NVI</em> and <em>DIA</em>. It then assigns each of these parts a specific ID number, which is the only language the math engine truly understands.</p><h3><strong>Step 2: Embedding Lookup - The GPS Map of Meaning</strong></h3><p>Next, the LLM finds the coordinates for each ID number in the <em>Embedding Layer</em>. The <em>embedding layer</em> acts like a map, where every word has a specific set of numerical coordinates based on meaning. Here, instead of referencing a dictionary definition, the model refers to a location that mathematically links the word to all other related concepts. For example, <em>Profit</em> is near <em>Revenue</em>, and <em>Shortage</em> is close to <em>Price Increase</em>.</p><p>The LLM then sees a long string of numbers (a <em>vector</em>) that mathematically represents <em>Semiconductors</em>, <em>Jensen Huang</em>, and <em>Compute Power</em>. This <em>vector</em> is not just a point in 3D space. The vector space often has over 4,000 dimensions, each capturing a different nuance of the word. Now, the LLM knows the contextual neighborhood of our question.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!r7My!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b20cbc9-5657-4ab2-bef1-9b387f6a3e5b_2549x1434.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!r7My!, /__u/zahed.substack.com/w_424, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b20cbc9-5657-4ab2-bef1-9b387f6a3e5b_2549x1434.png 424w, /__u/substackcdn.com/image/fetch/$s_!r7My!, /__u/zahed.substack.com/w_848, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b20cbc9-5657-4ab2-bef1-9b387f6a3e5b_2549x1434.png 848w, /__u/substackcdn.com/image/fetch/$s_!r7My!, /__u/zahed.substack.com/w_1272, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b20cbc9-5657-4ab2-bef1-9b387f6a3e5b_2549x1434.png 1272w, /__u/substackcdn.com/image/fetch/$s_!r7My!, /__u/zahed.substack.com/w_1456, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b20cbc9-5657-4ab2-bef1-9b387f6a3e5b_2549x1434.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!r7My!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b20cbc9-5657-4ab2-bef1-9b387f6a3e5b_2549x1434.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/9b20cbc9-5657-4ab2-bef1-9b387f6a3e5b_2549x1434.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!r7My!, /__u/zahed.substack.com/w_424, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b20cbc9-5657-4ab2-bef1-9b387f6a3e5b_2549x1434.png 424w, /__u/substackcdn.com/image/fetch/$s_!r7My!, /__u/zahed.substack.com/w_848, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b20cbc9-5657-4ab2-bef1-9b387f6a3e5b_2549x1434.png 848w, /__u/substackcdn.com/image/fetch/$s_!r7My!, /__u/zahed.substack.com/w_1272, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b20cbc9-5657-4ab2-bef1-9b387f6a3e5b_2549x1434.png 1272w, /__u/substackcdn.com/image/fetch/$s_!r7My!, /__u/zahed.substack.com/w_1456, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9b20cbc9-5657-4ab2-bef1-9b387f6a3e5b_2549x1434.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption"><em>The GPS Map of Meaning: In this vector space, tokens for 'NVIDIA' and 'GPU' are mathematically tethered together because they frequently appear in the same statistical neighborhoods.</em></figcaption></figure></div><h2><strong>How Coordinates Become Context</strong></h2><p>The numerical coordinates move through multiple <em>Transformer Blocks</em>, like stops on a factory line. Instead of each layer doing a completely different job, every block performs a similar task: the LLM employs the <em>Attention</em> mechanism to re-scan our entire sentence and update the coordinates of our words. </p><p>With every layer the data passes through, the mathematical relationship between our words becomes more precise. By the time the data reaches the final layers, the model has polished the math enough to see the deep, logical thread connecting a mention of <em>NVIDIA </em>at the top of the page to a <em>Strong Buy </em>signal at the bottom.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!i7ml!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F488e9560-80a3-46b1-b8cd-52141c813063_2549x1434.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!i7ml!, /__u/zahed.substack.com/w_424, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F488e9560-80a3-46b1-b8cd-52141c813063_2549x1434.png 424w, /__u/substackcdn.com/image/fetch/$s_!i7ml!, /__u/zahed.substack.com/w_848, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F488e9560-80a3-46b1-b8cd-52141c813063_2549x1434.png 848w, /__u/substackcdn.com/image/fetch/$s_!i7ml!, /__u/zahed.substack.com/w_1272, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F488e9560-80a3-46b1-b8cd-52141c813063_2549x1434.png 1272w, /__u/substackcdn.com/image/fetch/$s_!i7ml!, /__u/zahed.substack.com/w_1456, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F488e9560-80a3-46b1-b8cd-52141c813063_2549x1434.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!i7ml!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F488e9560-80a3-46b1-b8cd-52141c813063_2549x1434.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/488e9560-80a3-46b1-b8cd-52141c813063_2549x1434.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!i7ml!, /__u/zahed.substack.com/w_424, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F488e9560-80a3-46b1-b8cd-52141c813063_2549x1434.png 424w, /__u/substackcdn.com/image/fetch/$s_!i7ml!, /__u/zahed.substack.com/w_848, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F488e9560-80a3-46b1-b8cd-52141c813063_2549x1434.png 848w, /__u/substackcdn.com/image/fetch/$s_!i7ml!, /__u/zahed.substack.com/w_1272, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F488e9560-80a3-46b1-b8cd-52141c813063_2549x1434.png 1272w, /__u/substackcdn.com/image/fetch/$s_!i7ml!, /__u/zahed.substack.com/w_1456, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F488e9560-80a3-46b1-b8cd-52141c813063_2549x1434.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption"><em>A stack of Transformer Blocks where each layer polishes the mathematical coordinates of our prompt to sharpen the model&#8217;s prediction.</em></figcaption></figure></div><h2><strong>A 50,000-Candidate Election</strong></h2><p>After the blocks finish their work, the LLM reaches the <em>Output Layer </em>to produce raw scores. Because the previous blocks have sharpened the coordinates of our sentence, the model can now hold a giant election across its entire dictionary of 50,000 to 100,000 words, assigning a raw score to every single one:</p><ul><li><p><code>Buy: 18.5 points</code></p></li><li><p><code>Sell: 4.2 points</code></p></li><li><p><code>Banana: -10.0 points</code></p></li></ul><p>The model then converts these raw scores into percentages using the <em>Softmax</em> function. If <em>Buy</em> gets 89% of the vote, the LLM picks the winner.</p><p>However, we can adjust a setting called <em>Temperature</em>. A higher <em>temperature</em> allows the LLM to occasionally pick the second or third choice, which makes it feel more creative and less robotic.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!dcGH!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fecc464ae-cb99-4295-9042-e5bd8931c2e3_2549x1434.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!dcGH!, /__u/zahed.substack.com/w_424, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fecc464ae-cb99-4295-9042-e5bd8931c2e3_2549x1434.png 424w, /__u/substackcdn.com/image/fetch/$s_!dcGH!, /__u/zahed.substack.com/w_848, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fecc464ae-cb99-4295-9042-e5bd8931c2e3_2549x1434.png 848w, /__u/substackcdn.com/image/fetch/$s_!dcGH!, /__u/zahed.substack.com/w_1272, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fecc464ae-cb99-4295-9042-e5bd8931c2e3_2549x1434.png 1272w, /__u/substackcdn.com/image/fetch/$s_!dcGH!, /__u/zahed.substack.com/w_1456, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fecc464ae-cb99-4295-9042-e5bd8931c2e3_2549x1434.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!dcGH!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fecc464ae-cb99-4295-9042-e5bd8931c2e3_2549x1434.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/ecc464ae-cb99-4295-9042-e5bd8931c2e3_2549x1434.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!dcGH!, /__u/zahed.substack.com/w_424, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fecc464ae-cb99-4295-9042-e5bd8931c2e3_2549x1434.png 424w, /__u/substackcdn.com/image/fetch/$s_!dcGH!, /__u/zahed.substack.com/w_848, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fecc464ae-cb99-4295-9042-e5bd8931c2e3_2549x1434.png 848w, /__u/substackcdn.com/image/fetch/$s_!dcGH!, /__u/zahed.substack.com/w_1272, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fecc464ae-cb99-4295-9042-e5bd8931c2e3_2549x1434.png 1272w, /__u/substackcdn.com/image/fetch/$s_!dcGH!, /__u/zahed.substack.com/w_1456, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fecc464ae-cb99-4295-9042-e5bd8931c2e3_2549x1434.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption"><em>Raw scores are converted into percentages. Adjusting the Temperature dial determines if the model picks the 89% winner or takes a creative risk on a runner-up.</em></figcaption></figure></div><div class="captioned-button-wrap" data-attrs="{&quot;url&quot;:&quot;https://zahed.substack.com/p/the-assembly-line-of-ai-logic?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="CaptionedButtonToDOM"><div class="preamble"><p class="cta-caption">Thanks for reading my Substack! This post is public so feel free to share it.</p></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://zahed.substack.com/p/the-assembly-line-of-ai-logic?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="ButtonCreateButton"><a class="button primary" href="/__u/zahed.substack.com/p/the-assembly-line-of-ai-logic?utm_source=substack&amp;utm_medium=email&amp;utm_content=share&amp;action=share"><span>Share</span></a></p></div><h2><strong>The Predictive Feedback Loop</strong></h2><p>How does the LLM do this for paragraphs or pages?</p><p>It may seem like the LLM writes everything at once, but it actually predicts one word at a time. This is called <em>Autoregression</em>. After the LLM predicts <em>Buy</em>, it feeds that word back into its memory and repeats the process to find the next word.</p><ul><li><p><strong>Loop 1:</strong> <em>Buy</em></p></li><li><p><strong>Loop 2:</strong> <em>Buy</em> + <em>NVIDIA</em></p></li><li><p><strong>Loop 3:</strong> <em>Buy</em> + <em>NVIDIA</em> + <em>Because</em></p></li></ul><h2><strong>The Stadium of Digital Students</strong></h2><p>You might wonder how the LLM produces results so quickly. Its speed actually comes from specialized hardware.</p><p>Think of the GPU as a stadium full of students all racing to solve math problems. To keep things fast, the model uses a digital scratchpad called <em>KV Caching.</em> Instead of re-reading our prompt for every word, it remembers its prior work and only recalculates the new information.</p><div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;48f4dbca-af0e-400c-a394-9f50dc770c3f&quot;,&quot;duration&quot;:null}"></div><p>Ultimately, we should not view the LLM as a database of facts. Instead, we should recognize it as a mathematical simulation of human logic. By mapping the distance between ideas and weighing the importance of connections, it uses massive computing power to predict the most likely path of a conversation.</p><div><hr></div><h2><strong>The Machine vs. Biology</strong></h2><p>Can AI truly replace a human mind?</p><p>Before we trust an AI agent with our money, we must compare it to the human brain. In my next post, we will look at the LLM and the brain side by side to see where the simulation ends and true intelligence begins.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!2_G8!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05a2dab4-5561-4568-b54e-70400de117fe_2549x1434.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!2_G8!, /__u/zahed.substack.com/w_424, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05a2dab4-5561-4568-b54e-70400de117fe_2549x1434.png 424w, /__u/substackcdn.com/image/fetch/$s_!2_G8!, /__u/zahed.substack.com/w_848, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05a2dab4-5561-4568-b54e-70400de117fe_2549x1434.png 848w, /__u/substackcdn.com/image/fetch/$s_!2_G8!, /__u/zahed.substack.com/w_1272, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05a2dab4-5561-4568-b54e-70400de117fe_2549x1434.png 1272w, /__u/substackcdn.com/image/fetch/$s_!2_G8!, /__u/zahed.substack.com/w_1456, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05a2dab4-5561-4568-b54e-70400de117fe_2549x1434.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!2_G8!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05a2dab4-5561-4568-b54e-70400de117fe_2549x1434.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/05a2dab4-5561-4568-b54e-70400de117fe_2549x1434.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!2_G8!, /__u/zahed.substack.com/w_424, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05a2dab4-5561-4568-b54e-70400de117fe_2549x1434.png 424w, /__u/substackcdn.com/image/fetch/$s_!2_G8!, /__u/zahed.substack.com/w_848, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05a2dab4-5561-4568-b54e-70400de117fe_2549x1434.png 848w, /__u/substackcdn.com/image/fetch/$s_!2_G8!, /__u/zahed.substack.com/w_1272, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05a2dab4-5561-4568-b54e-70400de117fe_2549x1434.png 1272w, /__u/substackcdn.com/image/fetch/$s_!2_G8!, /__u/zahed.substack.com/w_1456, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05a2dab4-5561-4568-b54e-70400de117fe_2549x1434.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption"><em>Can a statistical simulation of logic eventually replicate the biological complexity of human thought?</em></figcaption></figure></div><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://zahed.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Enjoyed this article? Subscribe for more.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[Stop worrying about AI and start building]]></title><description><![CDATA[I&#8217;m a Data Scientist at Google, analyzing generative AI tools that help customers create better advertising content.]]></description><link>https://zahed.substack.com/p/stop-worrying-about-ai-and-start</link><guid isPermaLink="false">https://zahed.substack.com/p/stop-worrying-about-ai-and-start</guid><dc:creator><![CDATA[Zahed Al Saifi]]></dc:creator><pubDate>Mon, 20 Apr 2026 14:13:58 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!qUYN!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff91ad143-e8a3-4a09-907e-3b2c375b712e_800x800.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>I&#8217;m a Data Scientist at Google, analyzing generative AI tools that help customers create better advertising content. My job involves understanding how these tools work, the impact they&#8217;re making on campaign performance, and how advertisers who use them see tangible benefits. Beyond my specific role, being at Google allows me to get hands-on with the latest AI models and tools before they&#8217;re released to the public.</p><p>Between my job and personal side projects, I realized two things:</p><ul><li><p><strong>Most people are understandably concerned that AI will replace their jobs.</strong></p></li><li><p><strong>The best way to plan for the future is to understand how these tools work so you can start building with them.</strong></p></li></ul><p>I&#8217;m starting this Substack because I want to bridge the gap between the black box of AI and the people who want to turn it into something useful.</p><p>This newsletter is a documentation of what I&#8217;m learning and building. In my posts, I&#8217;ll explain how AI actually works by diving into the technical details of LLMs and how they differ from the human brain. I&#8217;ll also introduce you to the dominant players&#8212;the companies building the models and the ones providing the massive infrastructure that powers them&#8212;so you can see the full picture of the industry.</p><p>As we progress through this series, I&#8217;ll share the projects I&#8217;ve built and ask you to try them out. The first of these is a financial advisor agent designed for beginners who want to invest but are overwhelmed by jargon. I constantly hear people say, &#8220;I want to buy stocks, but I don't know how to decide,&#8221; or &#8220;My friend told me to buy Nvidia before it goes up even more.&#8221; This tool is designed to cut through that noise. It explains how to select stocks and understand the metrics behind the process in plain English, using real-world examples and strategies.</p><p>Ultimately, I want to help you understand AI so you don&#8217;t fall behind. I believe that once you see how these systems are put together, you&#8217;ll stop seeing AI as a threat and start seeing it as a tool for your own ideas.</p><p>Everything here is free to read. I&#8217;m looking forward to sharing what I find and hearing your thoughts on what I should build next.</p><p>My first article is live. Click the button below to read it.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://open.substack.com/pub/zahed/p/stop-treating-llms-like-people-theyre?utm_campaign=post-expanded-share&amp;utm_medium=web&quot;,&quot;text&quot;:&quot;Stop Treating LLMs Like People&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="/__u/open.substack.com/pub/zahed/p/stop-treating-llms-like-people-theyre?utm_campaign=post-expanded-share&amp;utm_medium=web"><span>Stop Treating LLMs Like People</span></a></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://zahed.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="/__u/zahed.substack.com/subscribe"><span>Subscribe now</span></a></p>]]></content:encoded></item><item><title><![CDATA[Stop Treating LLMs Like People. They’re Statistical Engines.]]></title><description><![CDATA[LLMs don&#8217;t think; they calculate the next token. This process is pure math, performed at lightning speed.]]></description><link>https://zahed.substack.com/p/stop-treating-llms-like-people-theyre</link><guid isPermaLink="false">https://zahed.substack.com/p/stop-treating-llms-like-people-theyre</guid><dc:creator><![CDATA[Zahed Al Saifi]]></dc:creator><pubDate>Mon, 20 Apr 2026 14:10:31 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!-p60!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26bca39a-1701-4912-b706-19d06ddc53fa_2574x1448.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!-p60!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26bca39a-1701-4912-b706-19d06ddc53fa_2574x1448.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!-p60!, /__u/zahed.substack.com/w_424, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26bca39a-1701-4912-b706-19d06ddc53fa_2574x1448.png 424w, /__u/substackcdn.com/image/fetch/$s_!-p60!, /__u/zahed.substack.com/w_848, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26bca39a-1701-4912-b706-19d06ddc53fa_2574x1448.png 848w, /__u/substackcdn.com/image/fetch/$s_!-p60!, /__u/zahed.substack.com/w_1272, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26bca39a-1701-4912-b706-19d06ddc53fa_2574x1448.png 1272w, /__u/substackcdn.com/image/fetch/$s_!-p60!, /__u/zahed.substack.com/w_1456, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26bca39a-1701-4912-b706-19d06ddc53fa_2574x1448.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!-p60!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26bca39a-1701-4912-b706-19d06ddc53fa_2574x1448.png" width="728" height="409.5353535353535" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/26bca39a-1701-4912-b706-19d06ddc53fa_2574x1448.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:false,&quot;imageSize&quot;:&quot;normal&quot;,&quot;height&quot;:1448,&quot;width&quot;:2574,&quot;resizeWidth&quot;:728,&quot;bytes&quot;:6326799,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:&quot;center&quot;,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!-p60!, /__u/zahed.substack.com/w_424, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26bca39a-1701-4912-b706-19d06ddc53fa_2574x1448.png 424w, /__u/substackcdn.com/image/fetch/$s_!-p60!, /__u/zahed.substack.com/w_848, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26bca39a-1701-4912-b706-19d06ddc53fa_2574x1448.png 848w, /__u/substackcdn.com/image/fetch/$s_!-p60!, /__u/zahed.substack.com/w_1272, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26bca39a-1701-4912-b706-19d06ddc53fa_2574x1448.png 1272w, /__u/substackcdn.com/image/fetch/$s_!-p60!, /__u/zahed.substack.com/w_1456, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26bca39a-1701-4912-b706-19d06ddc53fa_2574x1448.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption"><em>The illusion of a mind is generated by a vast, purely mechanical scoring system.</em></figcaption></figure></div><p>Before we explore AI agents and their complex tasks, it&#8217;s important to understand what Large Language Models (LLMs) are and how they work. When we ask our LLM agent, <em>&#8220;Should I buy NVIDIA stock today?&#8221;</em> it may feel like we&#8217;re consulting the best financial analyst at J.P. Morgan. In reality, hitting <em>Enter</em> on our keyboard triggers a high-speed, multi-layered statistical prediction engine. The LLM runs our question through mathematical filters to determine which words are most likely to emerge.</p><p>The LLM does not think. It simulates logic through scale and statistics.</p><div><hr></div><h2><strong>Why LLMs Treat Words Like GPS Coordinates</strong></h2><p>We often hear that an LLM is a <em>neural network</em>. What exactly is that?</p><p>A <em>neural network</em> is a massive mathematical system. While its name was inspired by how biological neurons fire, it is more helpful to see it as a vast, layered scoring mechanism that processes information in parallel.</p><p>Our brains use biological synapses to connect biological neurons, but an LLM uses artificial neurons. These are mathematical functions that weigh information before passing it along. Think of these neurons as tiny calculators on an assembly line. Each calculator examines incoming data, multiplies it by a weight, and decides whether to trigger the next calculator.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!5X_y!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5002dc98-4211-4c07-b129-53474b3e845c_2574x1448.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!5X_y!, /__u/zahed.substack.com/w_424, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5002dc98-4211-4c07-b129-53474b3e845c_2574x1448.png 424w, /__u/substackcdn.com/image/fetch/$s_!5X_y!, /__u/zahed.substack.com/w_848, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5002dc98-4211-4c07-b129-53474b3e845c_2574x1448.png 848w, /__u/substackcdn.com/image/fetch/$s_!5X_y!, /__u/zahed.substack.com/w_1272, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5002dc98-4211-4c07-b129-53474b3e845c_2574x1448.png 1272w, /__u/substackcdn.com/image/fetch/$s_!5X_y!, /__u/zahed.substack.com/w_1456, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5002dc98-4211-4c07-b129-53474b3e845c_2574x1448.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!5X_y!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5002dc98-4211-4c07-b129-53474b3e845c_2574x1448.png" width="2574" height="1448" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/5002dc98-4211-4c07-b129-53474b3e845c_2574x1448.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1448,&quot;width&quot;:2574,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:3933127,&quot;alt&quot;:&quot;s&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="s" title="s" srcset="/__u/substackcdn.com/image/fetch/$s_!5X_y!, /__u/zahed.substack.com/w_424, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5002dc98-4211-4c07-b129-53474b3e845c_2574x1448.png 424w, /__u/substackcdn.com/image/fetch/$s_!5X_y!, /__u/zahed.substack.com/w_848, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5002dc98-4211-4c07-b129-53474b3e845c_2574x1448.png 848w, /__u/substackcdn.com/image/fetch/$s_!5X_y!, /__u/zahed.substack.com/w_1272, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5002dc98-4211-4c07-b129-53474b3e845c_2574x1448.png 1272w, /__u/substackcdn.com/image/fetch/$s_!5X_y!, /__u/zahed.substack.com/w_1456, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5002dc98-4211-4c07-b129-53474b3e845c_2574x1448.png 1456w" sizes="100vw"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption"><em>This visualization represents the multidimensional map of meaning (embeddings). The connections between nodes (activation patterns) show how the attention mechanism relates tokens to one another.</em></figcaption></figure></div><p>Here&#8217;s an example:</p><p><code>Gemini: Hi Zahed, where should we start?</code></p><p><code>Zahed: Help me become rich.</code></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://zahed.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Subscribe for free to get the rest of this 3-week series delivered to your inbox. At the end, I&#8217;m sharing my <strong>Financial Advisor AI Agent</strong> to help you start building and investing.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p>To process my request, the LLM first breaks my sentence into small elements called <em>tokens</em>. A <em>token</em> is a basic unit of text, such as a whole word or a part of a word. Think of <em>tokens</em> as the Lego bricks of language.</p><p>The <em>tokens</em> are then placed on a multidimensional map of meaning, known as an <em>embedding</em>. An <em>embedding</em> is a mathematical representation that helps the LLM understand word relationships. In this mathematical landscape, words don't have definitions; they have locations. Because of the model&#8217;s construction, the token for <em>rich</em> is placed in a high-dimensional neighborhood surrounded by <em>wealth</em>, <em>assets</em>, and <em>investing</em>.</p><p>This data then travels through dozens of <em>Transformer</em> blocks. You can imagine these as specialized refinement filters in an assembly line. Within each block, a <em>Self-Attention </em>mechanism<em> </em>acts like a high-speed spotlight, instantly scanning the entire sentence to see how words tether to one another. It&#8217;s the math that ensures the model knows <em>rich</em> refers to financial status, not the flavor of cheesecake, by observing the context of the words around it.</p><blockquote><p>We should not think of knowledge in an LLM as a file on a hard drive. Instead, imagine it as a giant web of connections. Knowledge is encoded in the numerical values of billions of network parameters.</p></blockquote><h2><strong>How Models Learn through Error Correction</strong></h2><p>An LLM starts its life as a blank slate of random numbers.</p><p>To become effective, the LLM must undergo training. This training is a massive, high-speed loop of trial and error. Here is how that process works:</p><ul><li><p><strong>The Guess:</strong> The LLM receives a sequence of text and is tasked with predicting the very next <em>token</em> in that sequence. Using its current, initially random weights, it predicts the word.</p></li><li><p><strong>The Error:</strong> The LLM compares its guess to the actual word. The difference between the guess and the truth is called the <em>Loss</em>, a mathematical score that represents how incorrect the guess was.</p></li><li><p><strong>Backpropagation:</strong> The model works backward. It adjusts billions of internal parameters to ensure that if it saw that exact sentence again, it would make a smaller mistake.</p></li></ul><p>We can see that when an LLM learns that <em>NVIDIA</em> is often followed by <em>GPU</em>, it does not understand a business model. It has simply altered its weights to maximize the probability of that sequence.</p><p>During training, the model uses <em>gradient descent, </em>a mathematical method that gradually changes its <em>parameters</em> to minimize prediction error. To understand this, imagine you are at the top of a mountain with your eyes covered, trying to find your way down. You might go up or down along the way. Eventually, you reach one of the valleys. This is what the LLM does during <em>gradient descent.</em> It follows the steepest path down the mountain, adjusting its <em>parameters</em> until it reaches a valley, where the errors are smallest.</p><div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;fef85d57-60fe-48c6-802a-119fe983e4af&quot;,&quot;duration&quot;:null}"></div><h2><strong>Why AI Masters Patterns, Not Logic</strong></h2><p>Consider an LLM used for financial analysis. We feed it millions of reports and every relevant market document. While it may look like the model is studying the economy, it is actually identifying statistical, not economic, patterns.</p><ul><li><p><strong>Pattern A:</strong> If (Revenue is Up) + (Data Center Growth is High) + (CEO is Promising) &gt; Most likely next words are <em>Strong Buy</em>.</p></li><li><p><strong>Pattern B:</strong> If (Export Restrictions Tighten) + (Competition is Rising) &gt; Most likely next word is <em>Sell</em>.</p></li></ul><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!1vEE!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F70143c98-1afd-4680-b106-a7dfde158313_2574x1448.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!1vEE!, /__u/zahed.substack.com/w_424, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F70143c98-1afd-4680-b106-a7dfde158313_2574x1448.png 424w, /__u/substackcdn.com/image/fetch/$s_!1vEE!, /__u/zahed.substack.com/w_848, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F70143c98-1afd-4680-b106-a7dfde158313_2574x1448.png 848w, /__u/substackcdn.com/image/fetch/$s_!1vEE!, /__u/zahed.substack.com/w_1272, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F70143c98-1afd-4680-b106-a7dfde158313_2574x1448.png 1272w, /__u/substackcdn.com/image/fetch/$s_!1vEE!, /__u/zahed.substack.com/w_1456, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_webp, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F70143c98-1afd-4680-b106-a7dfde158313_2574x1448.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!1vEE!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F70143c98-1afd-4680-b106-a7dfde158313_2574x1448.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/70143c98-1afd-4680-b106-a7dfde158313_2574x1448.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!1vEE!, /__u/zahed.substack.com/w_424, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F70143c98-1afd-4680-b106-a7dfde158313_2574x1448.png 424w, /__u/substackcdn.com/image/fetch/$s_!1vEE!, /__u/zahed.substack.com/w_848, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F70143c98-1afd-4680-b106-a7dfde158313_2574x1448.png 848w, /__u/substackcdn.com/image/fetch/$s_!1vEE!, /__u/zahed.substack.com/w_1272, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F70143c98-1afd-4680-b106-a7dfde158313_2574x1448.png 1272w, /__u/substackcdn.com/image/fetch/$s_!1vEE!, /__u/zahed.substack.com/w_1456, /__u/zahed.substack.com/c_limit, /__u/zahed.substack.com/f_auto, /__u/zahed.substack.com/q_auto:good, /__u/zahed.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F70143c98-1afd-4680-b106-a7dfde158313_2574x1448.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption"><em>The final output of an LLM: The complex input is reduced to a final set of probability scores, which are then mapped to a categorical prediction like 'Strong Buy.'</em></figcaption></figure></div><p>So, when we ask the LLM for a prediction today, it does not analyze the stock market. It performs a calculation. Our words pass through its web of tuned connections to see which word is the best mathematical fit. Out of thousands of possible words in its vocabulary, it picks the one with the highest probability of being the next piece of the puzzle.</p><div><hr></div><h2><strong>The High-Dimensional Map</strong></h2><p>Now that we know how these models are built and trained, we need to see how they act under pressure. My next post will focus on the model&#8217;s behavior under stress: how the LLM transforms our words into math, navigates a map of meaning, and selects a <em>token</em> based on the final scores.</p><div class="captioned-button-wrap" data-attrs="{&quot;url&quot;:&quot;https://zahed.substack.com/p/stop-treating-llms-like-people-theyre?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="CaptionedButtonToDOM"><div class="preamble"><p class="cta-caption">Thanks for reading my Substack! This post is public so feel free to share it.</p></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://zahed.substack.com/p/stop-treating-llms-like-people-theyre?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="ButtonCreateButton"><a class="button primary" href="/__u/zahed.substack.com/p/stop-treating-llms-like-people-theyre?utm_source=substack&amp;utm_medium=email&amp;utm_content=share&amp;action=share"><span>Share</span></a></p></div>]]></content:encoded></item></channel></rss>