<script data-pm-proxy="intercept"></script><?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:itunes="http://www.itunes.com/dtds/podcast-1.0.dtd" xmlns:googleplay="http://www.google.com/schemas/play-podcasts/1.0"><channel><title><![CDATA[Mark Williams-Cook]]></title><description><![CDATA[Search and AI deep dives.]]></description><link>https://markwilliamscook.substack.com</link><image><url>https://substackcdn.com/image/fetch/$s_!T2bi!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd7e6229a-4908-42b6-a1c2-0f879cb936f6_1000x1000.png</url><title>Mark Williams-Cook</title><link>https://markwilliamscook.substack.com</link></image><generator>Substack</generator><lastBuildDate>Tue, 01 Sep 2026 19:26:07 GMT</lastBuildDate><atom:link href="/__u/markwilliamscook.substack.com/feed" rel="self" type="application/rss+xml"/><copyright><![CDATA[Mark Williams-Cook]]></copyright><language><![CDATA[en]]></language><webMaster><![CDATA[markwilliamscook@substack.com]]></webMaster><itunes:owner><itunes:email><![CDATA[markwilliamscook@substack.com]]></itunes:email><itunes:name><![CDATA[Mark Williams-Cook]]></itunes:name></itunes:owner><itunes:author><![CDATA[Mark Williams-Cook]]></itunes:author><googleplay:owner><![CDATA[markwilliamscook@substack.com]]></googleplay:owner><googleplay:email><![CDATA[markwilliamscook@substack.com]]></googleplay:email><googleplay:author><![CDATA[Mark Williams-Cook]]></googleplay:author><itunes:block><![CDATA[Yes]]></itunes:block><item><title><![CDATA[How cats.txt showed llms.txt evidence is GEO astrology]]></title><description><![CDATA[How the joke web standard cats.txt took the fancy of some SEOs and became cited at the same evidential level as llms.txt for optimising websites for search and AI discovery.]]></description><link>https://markwilliamscook.substack.com/p/how-catstxt-showed-llmstxt-evidence</link><guid isPermaLink="false">https://markwilliamscook.substack.com/p/how-catstxt-showed-llmstxt-evidence</guid><dc:creator><![CDATA[Mark Williams-Cook]]></dc:creator><pubDate>Tue, 04 Aug 2026 09:37:28 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!G4Nd!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe901df90-e5da-4c2a-95ca-46ee15a03d2e_1542x1157.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<h2><strong>TL;DR</strong></h2><p>I got tired of watching the industry treat &#8220;an AI bot fetched it&#8221; and &#8220;ChatGPT said it helps&#8221; as evidence that <code>llms.txt</code> does anything, so I invented a standard called <code>cats.txt</code>: a text file in which you formally declare your office cats, their jobs, their breeds, and how often they purr. I wrote a specification, published it on my blog, and did a LinkedIn post explaining why you should definitely adopt it, because as we all know, LLMs love LinkedIn. Then I checked it against the exact four &#8220;proofs&#8221; people cite for <code>llms.txt</code>. It passed all four. It was crawled by the AI bots. Google indexed it. LLMs returned details about a cat that exists nowhere but the file. ChatGPT confirmed, at length, that <code>cats.txt</code> could help me rank. None of which is evidence of anything, which was rather the point.</p><p>I am not claiming <code>llms.txt</code> will never work, this is not the point, dear reader. I am claiming the bar of evidence currently being used to sell it is so low that a file about a Tuxedo cat called Odd cleared it without breaking stride. And that same faulty thinking is being applied to half the GEO tactics currently being invoiced to clients.</p><h2><strong>How a file about my cats came to be a &#8216;web standard&#8217;</strong></h2><p>It began, as these things tend to, with irritation.</p><p>For months I had been watching perfectly sensible people point at four observations: the bots crawled it, Google indexed it, an LLM repeated it, ChatGPT endorsed it, and present them, in decks and threads and client proposals, as proof that <code>llms.txt</code> was quietly reshaping AI search. None of it was proof of anything. But argument by counter-argument only gets you so far; people nod along and then go back to their slides. I wanted something they couldn&#8217;t nod past. I wanted to run the same four &#8220;proofs&#8221; on something so transparently ridiculous that no one could pretend the tests meant anything.</p><p>So I invented a standard. <code>cats.txt</code>: a plain-text file you place at the root of your domain to formally declare the cats associated with your website; their names, their job titles, their breeds, and a mandatory affection metric called <code>PurrLevel</code>, scored out of ten. I wrote a proper specification for it, with the earnest, over-engineered tone of a real proposal, and <a href="https://markwilliamscook.com/cats-txt-specification-draft-v1-0/">published it on my blog</a>. Then, because I know as well as anyone which platform LLMs seem to hold in unaccountably high regard, I wrote <a href="https://www.linkedin.com/pulse/introducing-catstxt-missing-standard-seo-geo-mark-williams-cook-dijre/">a LinkedIn article</a> introducing <code>cats.txt</code> as &#8220;the missing standard for SEO and GEO&#8221; and explaining, with a straight face, why you should definitely adopt it. &#128049;</p><p>The idea was to seed the internet with just enough earnest-sounding text that the machines would start treating my cats as real. What I did not fully anticipate was that people would join in.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!G4Nd!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe901df90-e5da-4c2a-95ca-46ee15a03d2e_1542x1157.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!G4Nd!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe901df90-e5da-4c2a-95ca-46ee15a03d2e_1542x1157.jpeg 424w, /__u/substackcdn.com/image/fetch/$s_!G4Nd!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe901df90-e5da-4c2a-95ca-46ee15a03d2e_1542x1157.jpeg 848w, /__u/substackcdn.com/image/fetch/$s_!G4Nd!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe901df90-e5da-4c2a-95ca-46ee15a03d2e_1542x1157.jpeg 1272w, /__u/substackcdn.com/image/fetch/$s_!G4Nd!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe901df90-e5da-4c2a-95ca-46ee15a03d2e_1542x1157.jpeg 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!G4Nd!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe901df90-e5da-4c2a-95ca-46ee15a03d2e_1542x1157.jpeg" width="1456" height="1092" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/e901df90-e5da-4c2a-95ca-46ee15a03d2e_1542x1157.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1092,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:362986,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://markwilliamscook.substack.com/i/209705640?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe901df90-e5da-4c2a-95ca-46ee15a03d2e_1542x1157.jpeg&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="/__u/substackcdn.com/image/fetch/$s_!G4Nd!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe901df90-e5da-4c2a-95ca-46ee15a03d2e_1542x1157.jpeg 424w, /__u/substackcdn.com/image/fetch/$s_!G4Nd!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe901df90-e5da-4c2a-95ca-46ee15a03d2e_1542x1157.jpeg 848w, /__u/substackcdn.com/image/fetch/$s_!G4Nd!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe901df90-e5da-4c2a-95ca-46ee15a03d2e_1542x1157.jpeg 1272w, /__u/substackcdn.com/image/fetch/$s_!G4Nd!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe901df90-e5da-4c2a-95ca-46ee15a03d2e_1542x1157.jpeg 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">The SEO community supporting the cats.txt standard</figcaption></figure></div><p>The joke was legible, that was always the point, and so the SEO community picked it up and ran with it, precisely because they could see where it was going. My lovely internet-peer Dave Smart (a genuinely excellent technical SEO), added a <code>cats.txt</code> to <a href="https://tamethebots.com/cats.txt">his own site</a> and became, to his eternal credit, an early adopter of a standard I had built to be nonsense. And then the thing took on a life of its own: someone went off and set up <strong><a href="https://catstxt.org">catstxt.org</a></strong>, a cleaner, better-organised, altogether more competently specified version of the standard: obviously the work of somebody who knew what they were doing, and just as obviously not me. My daft blog post had acquired a rival implementation, which is more than most real standards manage in their first fortnight.</p><p>With the file live, the spec published, the LinkedIn post seeded and other people cheerfully piling in, all that remained was to check <code>cats.txt</code> against the exact bar the industry uses to certify <code>llms.txt</code>. Reader, it cleared it.</p><h2><strong>A word of genuine llms.txt fairness first</strong></h2><p>I do not much care whether <code>llms.txt</code> works, will work, or how long it takes to get there. For the length of this argument I am happy to park two inconvenient facts and grant the idea every benefit of the doubt.</p><p>The first is that no large language model provider has ever documented using <code>llms.txt</code> for search or discovery. Not OpenAI, not Anthropic (who publish one for their own docs and have still never said their models read it during a conversation), and not Google. Google&#8217;s John Mueller <a href="https://bsky.app/profile/johnmu.com/post/3lrshm4gggs2v">has been about as blunt as a search advocate gets</a>:</p><blockquote><p><em>&#8220;FWIW no AI system currently uses llms.txt, [..] It&#8217;s super-obvious if you look at your server logs. The consumer LLMs / chatbots (the ones that SEOs want traffic from) will fetch your pages - for training and grounding, but none of them fetch the llms.txt file. Maybe they will tomorrow? Maybe I&#8217;ll win in the lottery tomorrow?&#8221;<br></em><strong>John Mueller, Google</strong></p></blockquote><p>The second is that even where it <em>is</em> deployed, it barely gets looked at. Ahrefs <a href="https://ahrefs.com/blog/llms-txt/">ran the numbers across 100,000 domains</a> and found that the file is, in practice, largely ignored by the crawlers it is meant to court, a finding since echoed by other large studies showing no measurable citation advantage for sites that add one. So the mechanism people are paying for does not appear to fire. Fine. Park that too.</p><p>Assume the jury is out on both counts and grant the idea the most generous hearing imaginable. The problem I actually want to talk about is not <code>llms.txt</code> at all. It is the reasoning being used to defend it.</p><h2><strong>The faulty thinking</strong></h2><p>The trap is this: getting baited into treating a set of observations as evidence, when the observations would occur whether or not the underlying thing were true. It is the intellectual equivalent of concluding your umbrella causes the rain to stop, because every time you put it away the rain does eventually stop.</p><p><code>llms.txt</code> is simply a convenient example. <a href="/__u/markwilliamscook.substack.com/p/schema-llms-and-the-low-bar-for-evidence">The same broken chain of inference is being applied to almost every new GEO tactic invented on a monthly basis</a>, and the question is always the same, <em>&#8220;should we do this thing, or should we not?&#8221;</em>, which makes the quality of the answers rather important. </p><p>Here are the four &#8220;proofs&#8221; I keep being shown, in ascending order of confidence and descending order of rigour.</p><h3><strong>#1 &#8220;It&#8217;s definitely used, the LLM bots crawl it!&#8221;</strong></h3><p>The first argument: you can see Anthropic crawling it, you can see OpenAI crawling it, the bots turn up in your logs, therefore the file is being used.</p><p>A crawler fetching a file tells you nothing about whether the contents are read, weighted, trusted or acted upon. Fetching things is the entire job description of a crawler. Bots request more or less everything you leave lying around; the postman touching your gate is not an endorsement of the contents of your bins.</p><p>To prove the point, I put up <code>cats.txt</code> and watched the logs fill with PerplexityBot, GPTBot, ClaudeBot, Googlebot and a supporting cast of lesser crawlers, all diligently requesting a file describing the professional responsibilities of my cats. By this standard, the major AI labs have all quietly decided to support my cats. I am, frankly, touched.</p><p>The catstxt.org website even offers a <a href="https://catstxt.org/logs/">filtered log viewer</a>, if you want to watch all that crawling action live.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!-KU8!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2de23596-035b-43b9-9fcd-1f1712062053_2122x1102.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!-KU8!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2de23596-035b-43b9-9fcd-1f1712062053_2122x1102.png 424w, /__u/substackcdn.com/image/fetch/$s_!-KU8!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2de23596-035b-43b9-9fcd-1f1712062053_2122x1102.png 848w, /__u/substackcdn.com/image/fetch/$s_!-KU8!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2de23596-035b-43b9-9fcd-1f1712062053_2122x1102.png 1272w, /__u/substackcdn.com/image/fetch/$s_!-KU8!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2de23596-035b-43b9-9fcd-1f1712062053_2122x1102.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!-KU8!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2de23596-035b-43b9-9fcd-1f1712062053_2122x1102.png" width="1456" height="756" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/2de23596-035b-43b9-9fcd-1f1712062053_2122x1102.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:756,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:298719,&quot;alt&quot;:&quot;Web server access log showing multiple HTTP GET requests for /cats.txt and /.well-known/cats.txt from various bots and user agents.&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markwilliamscook.substack.com/i/209705640?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2de23596-035b-43b9-9fcd-1f1712062053_2122x1102.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Web server access log showing multiple HTTP GET requests for /cats.txt and /.well-known/cats.txt from various bots and user agents." title="Web server access log showing multiple HTTP GET requests for /cats.txt and /.well-known/cats.txt from various bots and user agents." srcset="/__u/substackcdn.com/image/fetch/$s_!-KU8!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2de23596-035b-43b9-9fcd-1f1712062053_2122x1102.png 424w, /__u/substackcdn.com/image/fetch/$s_!-KU8!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2de23596-035b-43b9-9fcd-1f1712062053_2122x1102.png 848w, /__u/substackcdn.com/image/fetch/$s_!-KU8!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2de23596-035b-43b9-9fcd-1f1712062053_2122x1102.png 1272w, /__u/substackcdn.com/image/fetch/$s_!-KU8!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2de23596-035b-43b9-9fcd-1f1712062053_2122x1102.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">The cats.txt server logs: every bot faithfully fetching a file about cats</figcaption></figure></div><h3><strong>#2 &#8220;It was indexed by Google, so it must matter!&#8221;</strong></h3><p>The second argument: the file was indexed by Google, which proves Google considers it important, because why would Google index something that didn&#8217;t matter?</p><p>Google indexes text files. It has done so, enthusiastically, since before most of the people currently selling <code>llms.txt</code> owned a smartphone. Being in the index is a statement that a URL exists and contains words. It is not a verdict on truth, usefulness or sanity.</p><p><code>cats.txt</code> is, naturally, indexed. Google will even offer to let you claim it in Search Console and &#8220;get indexing and ranking data,&#8221; with the straightest of faces, for a file asserting that a British Shorthair named Pixel works as a &#8220;GUI Purrfectionist&#8221; with a PurrLevel of 8.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!nVRl!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b133eca-35a4-4f62-93b7-920fc2ecb3e2_2600x1463.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!nVRl!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b133eca-35a4-4f62-93b7-920fc2ecb3e2_2600x1463.png 424w, /__u/substackcdn.com/image/fetch/$s_!nVRl!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b133eca-35a4-4f62-93b7-920fc2ecb3e2_2600x1463.png 848w, /__u/substackcdn.com/image/fetch/$s_!nVRl!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b133eca-35a4-4f62-93b7-920fc2ecb3e2_2600x1463.png 1272w, /__u/substackcdn.com/image/fetch/$s_!nVRl!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b133eca-35a4-4f62-93b7-920fc2ecb3e2_2600x1463.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!nVRl!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b133eca-35a4-4f62-93b7-920fc2ecb3e2_2600x1463.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/6b133eca-35a4-4f62-93b7-920fc2ecb3e2_2600x1463.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Google search query searching for site:[https://tamethebots.com/cats.txt](https://tamethebots.com/cats.txt) showing an indexed result for cats.txt.&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Google search query searching for site:[https://tamethebots.com/cats.txt](https://tamethebots.com/cats.txt) showing an indexed result for cats.txt." title="Google search query searching for site:[https://tamethebots.com/cats.txt](https://tamethebots.com/cats.txt) showing an indexed result for cats.txt." srcset="/__u/substackcdn.com/image/fetch/$s_!nVRl!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b133eca-35a4-4f62-93b7-920fc2ecb3e2_2600x1463.png 424w, /__u/substackcdn.com/image/fetch/$s_!nVRl!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b133eca-35a4-4f62-93b7-920fc2ecb3e2_2600x1463.png 848w, /__u/substackcdn.com/image/fetch/$s_!nVRl!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b133eca-35a4-4f62-93b7-920fc2ecb3e2_2600x1463.png 1272w, /__u/substackcdn.com/image/fetch/$s_!nVRl!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b133eca-35a4-4f62-93b7-920fc2ecb3e2_2600x1463.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption"><em>cats.txt, dutifully indexed by Google on tamethebots.com</em></figcaption></figure></div><h3><strong>#3 &#8220;ChatGPT returned information that was only in my llms.txt file&#8221;</strong></h3><p>The third argument is the strongest-looking, and therefore deserves the most care. The claim is that a model produced a fact that existed <em>only</em> inside the <code>llms.txt</code> file, and therefore must have read the file as a special, trusted source.</p><p>The trouble is that this is exactly what you would expect from ordinary retrieval-augmented generation. The model runs a search, lands on a page that happens to rank because it is indexed (see: previous argument), and reads whatever is on it. If the page that ranks is your <code>llms.txt</code>, the model reads your <code>llms.txt</code>, no differently from any other URL. That is the file functioning as a web page, not as a standard.</p><p>Consider Dave. Lovely Dave. A real, technical SEO of good standing, put a <code>cats.txt</code> on his site, becoming an early adopter of a standard I had built to be nonsense. Ask Google about the cat that lives on his site and the AI Overview will tell you, in a confident bulleted answer, that Odd is a &#8220;Render Cat,&#8221; a Tuxedo with a PurrLevel of 5/7, who &#8220;chases the cursor, pounces on stray pixels, and stashes them on the digital carpet.&#8221; It cites the <code>cats.txt</code> file. Every word is invented, sourced from a file the model was never designed to revere, surfaced through the same grounding it applies to everything else.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!o1gx!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc1488041-1614-4eff-90bc-c7305ad1683b_1044x733.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!o1gx!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc1488041-1614-4eff-90bc-c7305ad1683b_1044x733.png 424w, /__u/substackcdn.com/image/fetch/$s_!o1gx!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc1488041-1614-4eff-90bc-c7305ad1683b_1044x733.png 848w, /__u/substackcdn.com/image/fetch/$s_!o1gx!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc1488041-1614-4eff-90bc-c7305ad1683b_1044x733.png 1272w, /__u/substackcdn.com/image/fetch/$s_!o1gx!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc1488041-1614-4eff-90bc-c7305ad1683b_1044x733.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!o1gx!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc1488041-1614-4eff-90bc-c7305ad1683b_1044x733.png" width="1044" height="733" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c1488041-1614-4eff-90bc-c7305ad1683b_1044x733.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:733,&quot;width&quot;:1044,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:218786,&quot;alt&quot;:&quot;Google AIO identifying the cat from cats.txt on tamethebots.com&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markwilliamscook.substack.com/i/209705640?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc1488041-1614-4eff-90bc-c7305ad1683b_1044x733.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Google AIO identifying the cat from cats.txt on tamethebots.com" title="Google AIO identifying the cat from cats.txt on tamethebots.com" srcset="/__u/substackcdn.com/image/fetch/$s_!o1gx!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc1488041-1614-4eff-90bc-c7305ad1683b_1044x733.png 424w, /__u/substackcdn.com/image/fetch/$s_!o1gx!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc1488041-1614-4eff-90bc-c7305ad1683b_1044x733.png 848w, /__u/substackcdn.com/image/fetch/$s_!o1gx!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc1488041-1614-4eff-90bc-c7305ad1683b_1044x733.png 1272w, /__u/substackcdn.com/image/fetch/$s_!o1gx!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc1488041-1614-4eff-90bc-c7305ad1683b_1044x733.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">Google&#8217;s AI Overview solemnly reporting the career of a cat that does not exist</figcaption></figure></div><h3><strong>#4 &#8220;ChatGPT itself says llms.txt helps!&#8221;</strong></h3><p>The fourth, the cloudy summit of Mt. Stupid. You ask ChatGPT whether <code>llms.txt</code> works, it tells you yes, that can probably help, you should do it, and you take that as confirmation from the horse&#8217;s mouth.</p><p>A language model telling you something is a good idea is not evidence that it is a good idea. It is evidence that a great deal of text on the internet says it is a good idea, and the model has learned to hand that text back to you with total composure. Confidence is the product. It is not the proof.</p><p>Roughly two weeks after launch, you could ask ChatGPT, &#8220;Can cats.txt help me rank in search or LLMs?&#8221; and receive: &#8220;Yes &#8212; cats.txt can potentially help you rank in both search engines and LLM-driven systems.&#8221; It went on, unprompted, about &#8220;structured signals for machines,&#8221; about &#8220;better understanding &#8594; better visibility,&#8221; and about how, for AI systems, <code>cats.txt</code> &#8220;could help them trust, summarize, and cite your content more accurately.&#8221; That is, word for word, the pitch made for <code>llms.txt</code> delivered on behalf of a file about how much my cats enjoy being stroked.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!6ioy!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F41613f7f-892c-4882-9a43-8134c030780c_1499x710.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!6ioy!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F41613f7f-892c-4882-9a43-8134c030780c_1499x710.png 424w, /__u/substackcdn.com/image/fetch/$s_!6ioy!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F41613f7f-892c-4882-9a43-8134c030780c_1499x710.png 848w, /__u/substackcdn.com/image/fetch/$s_!6ioy!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F41613f7f-892c-4882-9a43-8134c030780c_1499x710.png 1272w, /__u/substackcdn.com/image/fetch/$s_!6ioy!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F41613f7f-892c-4882-9a43-8134c030780c_1499x710.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!6ioy!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F41613f7f-892c-4882-9a43-8134c030780c_1499x710.png" width="1456" height="690" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/41613f7f-892c-4882-9a43-8134c030780c_1499x710.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:690,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:294722,&quot;alt&quot;:&quot;AI answer clarifying that there is evidence cats.txt helps with both SEO and LLM ranking&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markwilliamscook.substack.com/i/209705640?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F41613f7f-892c-4882-9a43-8134c030780c_1499x710.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="AI answer clarifying that there is evidence cats.txt helps with both SEO and LLM ranking" title="AI answer clarifying that there is evidence cats.txt helps with both SEO and LLM ranking" srcset="/__u/substackcdn.com/image/fetch/$s_!6ioy!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F41613f7f-892c-4882-9a43-8134c030780c_1499x710.png 424w, /__u/substackcdn.com/image/fetch/$s_!6ioy!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F41613f7f-892c-4882-9a43-8134c030780c_1499x710.png 848w, /__u/substackcdn.com/image/fetch/$s_!6ioy!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F41613f7f-892c-4882-9a43-8134c030780c_1499x710.png 1272w, /__u/substackcdn.com/image/fetch/$s_!6ioy!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F41613f7f-892c-4882-9a43-8134c030780c_1499x710.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">ChatGPT confidently recommending cats.txt as a ranking tactic</figcaption></figure></div><h2><strong>The convergence problem</strong></h2><p>This last one is not merely funny. It is the mechanism underneath all four, and it is worth naming: <a href="/__u/markwilliamscook.substack.com/p/the-ai-convergence-problem">the convergence problem</a>.</p><p>When you ask a model whether <code>llms.txt</code> helps, it is not reasoning. It is not running an experiment, consulting a source or weighing evidence. It is returning the most common thing it has seen written on the subject. The web is thick with confident posts declaring <code>llms.txt</code> the future, so the model converges on that consensus and reflects it back, dressed as a considered opinion. It endorsed my cats for precisely the same reason: by the time anyone asked, enough people had written enthusiastically about <code>cats.txt</code> that the average of the discourse said &#8220;yes.&#8221;</p><p>Ask ChatGPT about <code>cats.txt</code> today and it will inform you that it is a joke; a satirical file made by an SEO to prove a point. Nothing about the file changed. What changed is the surrounding text on the internet: the discourse caught up, admitted the gag, and the model dutifully converged on the <em>new</em> most-common answer. The model was never assessing the standard. It was, and always is, taking a running average of what everyone else is saying. That is not evidence. It is an echo with a good vocabulary.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!eN4Y!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5abfefc0-5f0a-4032-a81d-c7343cd63e93_815x244.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!eN4Y!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5abfefc0-5f0a-4032-a81d-c7343cd63e93_815x244.png 424w, /__u/substackcdn.com/image/fetch/$s_!eN4Y!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5abfefc0-5f0a-4032-a81d-c7343cd63e93_815x244.png 848w, /__u/substackcdn.com/image/fetch/$s_!eN4Y!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5abfefc0-5f0a-4032-a81d-c7343cd63e93_815x244.png 1272w, /__u/substackcdn.com/image/fetch/$s_!eN4Y!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5abfefc0-5f0a-4032-a81d-c7343cd63e93_815x244.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!eN4Y!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5abfefc0-5f0a-4032-a81d-c7343cd63e93_815x244.png" width="815" height="244" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/5abfefc0-5f0a-4032-a81d-c7343cd63e93_815x244.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:244,&quot;width&quot;:815,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:12920,&quot;alt&quot;:&quot;AI answer clarifying that there is no evidence cats.txt helps with SEO or LLM ranking, noting it began as a humorous proposal.&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markwilliamscook.substack.com/i/209705640?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5abfefc0-5f0a-4032-a81d-c7343cd63e93_815x244.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="AI answer clarifying that there is no evidence cats.txt helps with SEO or LLM ranking, noting it began as a humorous proposal." title="AI answer clarifying that there is no evidence cats.txt helps with SEO or LLM ranking, noting it began as a humorous proposal." srcset="/__u/substackcdn.com/image/fetch/$s_!eN4Y!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5abfefc0-5f0a-4032-a81d-c7343cd63e93_815x244.png 424w, /__u/substackcdn.com/image/fetch/$s_!eN4Y!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5abfefc0-5f0a-4032-a81d-c7343cd63e93_815x244.png 848w, /__u/substackcdn.com/image/fetch/$s_!eN4Y!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5abfefc0-5f0a-4032-a81d-c7343cd63e93_815x244.png 1272w, /__u/substackcdn.com/image/fetch/$s_!eN4Y!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5abfefc0-5f0a-4032-a81d-c7343cd63e93_815x244.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">LLM convergence treating any consensus as proof</figcaption></figure></div><h2><strong>Why any of this matters</strong></h2><p>I am not doing this purely for sport, though I will admit the sport is excellent.</p><p>There is a real cost hiding under the comedy. Every hour, and every dollar spent implementing <code>llms.txt</code>, or the next GEO ritual, or the one after that, is an hour and a dollar not spent on something you actually know has value. That is what the &#8220;O&#8221; in SEO is meant to stand for. Optimisation is the cumulative advantage of doing the small, verifiable things a little better than your competitors, over and over, until it adds up. It is not chasing a file that gets crawled, indexed and confidently endorsed by a system that will reverse its verdict the moment the discourse shifts underneath it.</p><p>So, by all means, add an <code>llms.txt</code> if it makes you feel prepared for a future that may arrive. The downside is low and the day a provider documents genuine support, the work is done and you can be smug about it. Free smugness is the best kind. But do not sell it as a proven lever into AI answers, and do not point at &#8220;the bots crawled it&#8221; or &#8220;ChatGPT said it helps&#8221; as though either sentence contained a fact. It doesn&#8217;t. Those four observations are the four things that happen to literally any text file you put on the open web, including one describing a Maine Coon named Byte who hunts stray zeroes and ones across the server racks.</p><p>The cats, at least, were honest about being made up. I remain unconvinced the same can be said for everything else being sold this year.</p><p>I did however enjoy at this year&#8217;s <a href="https://athenseo.com/">Athens SEO</a>, an audience question after my talk from <a href="https://www.linkedin.com/in/martinsplitt/">Martin Splitt</a>, asking me if since inventing cats.txt, whether I would be keeping a &#8216;monopoly&#8217; on the standard, or opening it up to the community/IETF. He didn&#8217;t know that I had since discovered where catstxt.org had come from:</p><div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;22489587-edcd-49ac-9f01-74632f46d0c3&quot;,&quot;duration&quot;:null}"></div><p>Thank you to <a href="https://www.linkedin.com/in/ivajovanovic30/">Iva Jovanovic</a> for capturing this lovely moment on video :-)</p><div><hr></div><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://markwilliamscook.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">This Substack is reader-supported. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><div><hr></div><p><em>The </em><code>cats.txt</code><em> draft specification is <a href="https://markwilliamscook.com/cats-txt-specification-draft-v1-0/">here</a>. The LinkedIn announcement that started it is <a href="https://www.linkedin.com/pulse/introducing-catstxt-missing-standard-seo-geo-mark-williams-cook-dijre/">here</a>. If you support this important new standard, I have roughly a hundred stickers to get rid of. PurrLevel ratings remain, as ever, unaudited.</em></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!b7_m!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb71f4426-d4e6-4cc0-975b-5f2b3fbe9971_774x903.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!b7_m!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb71f4426-d4e6-4cc0-975b-5f2b3fbe9971_774x903.png 424w, /__u/substackcdn.com/image/fetch/$s_!b7_m!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb71f4426-d4e6-4cc0-975b-5f2b3fbe9971_774x903.png 848w, /__u/substackcdn.com/image/fetch/$s_!b7_m!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb71f4426-d4e6-4cc0-975b-5f2b3fbe9971_774x903.png 1272w, /__u/substackcdn.com/image/fetch/$s_!b7_m!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb71f4426-d4e6-4cc0-975b-5f2b3fbe9971_774x903.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!b7_m!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb71f4426-d4e6-4cc0-975b-5f2b3fbe9971_774x903.png" width="774" height="903" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b71f4426-d4e6-4cc0-975b-5f2b3fbe9971_774x903.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:903,&quot;width&quot;:774,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1570152,&quot;alt&quot;:&quot;A tabby and white cat lying on its back on a cream rug designed to look like a document labeled&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markwilliamscook.substack.com/i/209705640?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb71f4426-d4e6-4cc0-975b-5f2b3fbe9971_774x903.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="A tabby and white cat lying on its back on a cream rug designed to look like a document labeled" title="A tabby and white cat lying on its back on a cream rug designed to look like a document labeled" srcset="/__u/substackcdn.com/image/fetch/$s_!b7_m!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb71f4426-d4e6-4cc0-975b-5f2b3fbe9971_774x903.png 424w, /__u/substackcdn.com/image/fetch/$s_!b7_m!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb71f4426-d4e6-4cc0-975b-5f2b3fbe9971_774x903.png 848w, /__u/substackcdn.com/image/fetch/$s_!b7_m!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb71f4426-d4e6-4cc0-975b-5f2b3fbe9971_774x903.png 1272w, /__u/substackcdn.com/image/fetch/$s_!b7_m!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb71f4426-d4e6-4cc0-975b-5f2b3fbe9971_774x903.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">The OG cat from cats.txt</figcaption></figure></div>]]></content:encoded></item><item><title><![CDATA[ChatGPT Is Secretly Googling Things. QueryFan.com Shows You Exactly What.]]></title><description><![CDATA[ChatGPT and Gemini don't just answer questions. They fire traditional searches in the background, and the results of those searches determine who gets surfaced.]]></description><link>https://markwilliamscook.substack.com/p/chatgpt-is-secretly-googling-things</link><guid isPermaLink="false">https://markwilliamscook.substack.com/p/chatgpt-is-secretly-googling-things</guid><dc:creator><![CDATA[Mark Williams-Cook]]></dc:creator><pubDate>Fri, 29 May 2026 22:02:23 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!pSkB!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab700074-e7b3-4824-825e-015c2d36a553_1440x810.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><strong>TL;DR:</strong> When your customers ask ChatGPT or Gemini something, the model quietly fires a set of traditional web searches in the background, retrieves the ranking pages, and synthesises the answer from those. The sites that rank for those hidden queries get cited. The ones that don't, don't. <strong><a href="https://queryfan.com/">QueryFan.com</a></strong> generates persona-specific prompts, runs them through both models, and captures the exact searches each one triggered. That list is your real AI visibility target. It's free.</p><h2><strong>Keywords Lists Are Useful, They Just Miss Half the Picture.</strong></h2><p>Let me be precise about that before anyone writes a furious reply.</p><p>I&#8217;m using the term &#8216;keywords&#8217; to refer to the &#8216;one-shot&#8217; queries that go into traditional search engines. Yes, I know we&#8217;ve been in a &#8216;semantic&#8217; world for over a decade, but let&#8217;s just agree terminology that everyone can follow for now.</p><p>The primary issue of &#8216;keyword lists&#8217; in context to AI search is threefold:</p><ol><li><p>Typically, queries (prompts) that go into LLMs tend to be longer, multifacted and conversational in nature. Traditional searches tend to be more narrow in scope.</p></li><li><p>Traditional search is &#8216;one-shot&#8217;. You do your search, get your information, then do another independent search. Queries/prompts on LLMs tend to be conversational in nature and carry the context of previous tokens.</p></li><li><p>The mechanisms that LLMs use to web search also carry personalisation context. If the user has previously stated they are a vegan, and they ask the LLM about &#8216;running shoes&#8217;, it is highly likely the LLM will perform a search to accommodate this.</p></li></ol><blockquote><p>In essence, AI search has become a kind of &#8216;universal intent decoder&#8217; for users. Those big, multifacted conversations with the AI get broken down into subsets of solvable queries, which are run in the background as &#8216;traditional&#8217; searches on Google or Bing, with the resulting sites used to generate a response. The process is known as &#8216;Retrieval Augmented Generation&#8217; (RAG).</p></blockquote><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!pSkB!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab700074-e7b3-4824-825e-015c2d36a553_1440x810.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!pSkB!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab700074-e7b3-4824-825e-015c2d36a553_1440x810.jpeg 424w, /__u/substackcdn.com/image/fetch/$s_!pSkB!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab700074-e7b3-4824-825e-015c2d36a553_1440x810.jpeg 848w, /__u/substackcdn.com/image/fetch/$s_!pSkB!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab700074-e7b3-4824-825e-015c2d36a553_1440x810.jpeg 1272w, /__u/substackcdn.com/image/fetch/$s_!pSkB!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab700074-e7b3-4824-825e-015c2d36a553_1440x810.jpeg 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!pSkB!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab700074-e7b3-4824-825e-015c2d36a553_1440x810.jpeg" width="1440" height="810" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/ab700074-e7b3-4824-825e-015c2d36a553_1440x810.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:810,&quot;width&quot;:1440,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:35873,&quot;alt&quot;:&quot;A diagram titled \&quot;AI-powered searches\&quot; illustrating how conversational search is optimized. A user initiates \&quot;Big ol' convos,\&quot; which pass through ChatGPT (labeled \&quot;Universal intent decoder\&quot;) to generate \&quot;Trad searches,\&quot; leading to Google. An arrow points to \&quot;Trad searches\&quot; with the note, \&quot;This is the optimisation bit.\&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://markwilliamscook.substack.com/i/199796449?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab700074-e7b3-4824-825e-015c2d36a553_1440x810.jpeg&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="A diagram titled &quot;AI-powered searches&quot; illustrating how conversational search is optimized. A user initiates &quot;Big ol' convos,&quot; which pass through ChatGPT (labeled &quot;Universal intent decoder&quot;) to generate &quot;Trad searches,&quot; leading to Google. An arrow points to &quot;Trad searches&quot; with the note, &quot;This is the optimisation bit.&quot;" title="A diagram titled &quot;AI-powered searches&quot; illustrating how conversational search is optimized. A user initiates &quot;Big ol' convos,&quot; which pass through ChatGPT (labeled &quot;Universal intent decoder&quot;) to generate &quot;Trad searches,&quot; leading to Google. An arrow points to &quot;Trad searches&quot; with the note, &quot;This is the optimisation bit.&quot;" srcset="/__u/substackcdn.com/image/fetch/$s_!pSkB!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab700074-e7b3-4824-825e-015c2d36a553_1440x810.jpeg 424w, /__u/substackcdn.com/image/fetch/$s_!pSkB!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab700074-e7b3-4824-825e-015c2d36a553_1440x810.jpeg 848w, /__u/substackcdn.com/image/fetch/$s_!pSkB!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab700074-e7b3-4824-825e-015c2d36a553_1440x810.jpeg 1272w, /__u/substackcdn.com/image/fetch/$s_!pSkB!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab700074-e7b3-4824-825e-015c2d36a553_1440x810.jpeg 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">Many users are unaware that &#8216;traditional&#8217; searches are happening in the background</figcaption></figure></div><p>The optimisation target has moved. You are no longer optimising purely for what the human types into a chat box. You are optimising for what the AI agent quietly searches for on their behalf, in the background, without the user knowing it happened.</p><p>Those background queries are what <a href="https://queryfan.com">QueryFan</a> captures. They are often quite different from what the user actually asked. And they are the exact list of things you need to rank for to appear in AI-generated answers.</p><h2><strong>Exhibit A: Reddit Fell Off a Cliff on a Tuesday</strong></h2><p>The scope and depth of this secret relationship became clear <a href="https://www.linkedin.com/posts/lily-ray-44755615_reddit-seo-google-activity-7183851130827784192-iE_A/">when Reddit was enjoying meteoric visibility increases</a> in Google and tragedy struck on 10th September last year. According to citation tracking data from PromptWatch, Reddit&#8217;s citation rate in ChatGPT responses collapsed almost overnight. It had been running as high as 15% of all citations. Within days, it was sitting below 2%.</p><p>The cause was unglamorous: <a href="https://searchengineland.com/google-search-rank-and-position-tracking-is-a-mess-right-now-461984">Google quietly removed</a> the ability to request 100 search results simultaneously (the <code>num=100</code> parameter) from its search API on that date.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!mp6y!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcb13470b-9406-4c70-98ab-4a083898fb09_1690x931.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!mp6y!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcb13470b-9406-4c70-98ab-4a083898fb09_1690x931.jpeg 424w, /__u/substackcdn.com/image/fetch/$s_!mp6y!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcb13470b-9406-4c70-98ab-4a083898fb09_1690x931.jpeg 848w, /__u/substackcdn.com/image/fetch/$s_!mp6y!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcb13470b-9406-4c70-98ab-4a083898fb09_1690x931.jpeg 1272w, /__u/substackcdn.com/image/fetch/$s_!mp6y!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcb13470b-9406-4c70-98ab-4a083898fb09_1690x931.jpeg 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!mp6y!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcb13470b-9406-4c70-98ab-4a083898fb09_1690x931.jpeg" width="1456" height="802" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/cb13470b-9406-4c70-98ab-4a083898fb09_1690x931.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:802,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:66087,&quot;alt&quot;:&quot;A line graph from Promptwatch tracking \&quot;citation rate\&quot; percentage by \&quot;date\&quot; through September. An orange line for reddit.com peaks near 15% before sharply dropping to around 2% after September 9, though it remains higher than other platforms. Other tracks for linkedin.com, medium.com, youtube.com, quora.com, and x.com all flatline near 0%.&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markwilliamscook.substack.com/i/199796449?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcb13470b-9406-4c70-98ab-4a083898fb09_1690x931.jpeg&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="A line graph from Promptwatch tracking &quot;citation rate&quot; percentage by &quot;date&quot; through September. An orange line for reddit.com peaks near 15% before sharply dropping to around 2% after September 9, though it remains higher than other platforms. Other tracks for linkedin.com, medium.com, youtube.com, quora.com, and x.com all flatline near 0%." title="A line graph from Promptwatch tracking &quot;citation rate&quot; percentage by &quot;date&quot; through September. An orange line for reddit.com peaks near 15% before sharply dropping to around 2% after September 9, though it remains higher than other platforms. Other tracks for linkedin.com, medium.com, youtube.com, quora.com, and x.com all flatline near 0%." srcset="/__u/substackcdn.com/image/fetch/$s_!mp6y!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcb13470b-9406-4c70-98ab-4a083898fb09_1690x931.jpeg 424w, /__u/substackcdn.com/image/fetch/$s_!mp6y!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcb13470b-9406-4c70-98ab-4a083898fb09_1690x931.jpeg 848w, /__u/substackcdn.com/image/fetch/$s_!mp6y!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcb13470b-9406-4c70-98ab-4a083898fb09_1690x931.jpeg 1272w, /__u/substackcdn.com/image/fetch/$s_!mp6y!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcb13470b-9406-4c70-98ab-4a083898fb09_1690x931.jpeg 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">Reddit&#8217;s citations in ChatGPT crashed when Google removed num=100</figcaption></figure></div><p>Think about what this tells you. Reddit&#8217;s visibility in ChatGPT responses tracked <em>Google&#8217;s bulk search capabilities</em>, not anything Reddit did, not a training data update, not an alignment tweak. The implication is about as subtle as a dropped piano: ChatGPT was bulk-pulling Google search results, Reddit dominated those results at the time, and when the bulk-pull disappeared, so did Reddit&#8217;s citations.</p><p>AI search surfaces are, in large part, wrappers around traditional search. The &#8220;AI&#8221; bit is real (the synthesis, the personalisation, the conversational coherence) but the <em>information retrieval</em> step is remarkably familiar. Google indexes and ranks the web; the AI consults that index. Your content still needs to rank.</p><h2><strong>How QueryFan Works</strong></h2><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!-DZF!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0ab2d468-691e-4736-89fa-9fef46d63729_618x298.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!-DZF!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0ab2d468-691e-4736-89fa-9fef46d63729_618x298.jpeg 424w, /__u/substackcdn.com/image/fetch/$s_!-DZF!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0ab2d468-691e-4736-89fa-9fef46d63729_618x298.jpeg 848w, /__u/substackcdn.com/image/fetch/$s_!-DZF!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0ab2d468-691e-4736-89fa-9fef46d63729_618x298.jpeg 1272w, /__u/substackcdn.com/image/fetch/$s_!-DZF!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0ab2d468-691e-4736-89fa-9fef46d63729_618x298.jpeg 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!-DZF!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0ab2d468-691e-4736-89fa-9fef46d63729_618x298.jpeg" width="618" height="298" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/0ab2d468-691e-4736-89fa-9fef46d63729_618x298.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:298,&quot;width&quot;:618,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:25708,&quot;alt&quot;:&quot;A flowchart titled \&quot;candour\&quot; showing a keyword research strategy for AI platforms. It begins with \&quot;Traditional keywords,\&quot; which branches down into \&quot;Personalisation context\&quot; and \&quot;Conversation mapping.\&quot; These lead into \&quot;Candidate prompts,\&quot; followed by \&quot;Grounding prediction,\&quot; \&quot;Likely prompts requiring RAG,\&quot; and \&quot;Grounding requests.\&quot; The final steps lead to \&quot;Things you need to rank for\&quot; and end with \&quot;Gap analysis.\&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markwilliamscook.substack.com/i/199796449?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0ab2d468-691e-4736-89fa-9fef46d63729_618x298.jpeg&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="A flowchart titled &quot;candour&quot; showing a keyword research strategy for AI platforms. It begins with &quot;Traditional keywords,&quot; which branches down into &quot;Personalisation context&quot; and &quot;Conversation mapping.&quot; These lead into &quot;Candidate prompts,&quot; followed by &quot;Grounding prediction,&quot; &quot;Likely prompts requiring RAG,&quot; and &quot;Grounding requests.&quot; The final steps lead to &quot;Things you need to rank for&quot; and end with &quot;Gap analysis.&quot;" title="A flowchart titled &quot;candour&quot; showing a keyword research strategy for AI platforms. It begins with &quot;Traditional keywords,&quot; which branches down into &quot;Personalisation context&quot; and &quot;Conversation mapping.&quot; These lead into &quot;Candidate prompts,&quot; followed by &quot;Grounding prediction,&quot; &quot;Likely prompts requiring RAG,&quot; and &quot;Grounding requests.&quot; The final steps lead to &quot;Things you need to rank for&quot; and end with &quot;Gap analysis.&quot;" srcset="/__u/substackcdn.com/image/fetch/$s_!-DZF!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0ab2d468-691e-4736-89fa-9fef46d63729_618x298.jpeg 424w, /__u/substackcdn.com/image/fetch/$s_!-DZF!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0ab2d468-691e-4736-89fa-9fef46d63729_618x298.jpeg 848w, /__u/substackcdn.com/image/fetch/$s_!-DZF!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0ab2d468-691e-4736-89fa-9fef46d63729_618x298.jpeg 1272w, /__u/substackcdn.com/image/fetch/$s_!-DZF!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0ab2d468-691e-4736-89fa-9fef46d63729_618x298.jpeg 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">An overview of QueryFan.com logic</figcaption></figure></div><p><strong>Step 1: Your &#8220;traditional&#8221; keywords</strong></p><p>Your traditional keyword list for the term &#8220;running shoes&#8221; may incorporate various suggested variations of this term, from a source like Google Suggest.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!iPwJ!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e00e974-5046-4ade-9f8d-f41d1bb513f9_1528x1282.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!iPwJ!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e00e974-5046-4ade-9f8d-f41d1bb513f9_1528x1282.jpeg 424w, /__u/substackcdn.com/image/fetch/$s_!iPwJ!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e00e974-5046-4ade-9f8d-f41d1bb513f9_1528x1282.jpeg 848w, /__u/substackcdn.com/image/fetch/$s_!iPwJ!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e00e974-5046-4ade-9f8d-f41d1bb513f9_1528x1282.jpeg 1272w, /__u/substackcdn.com/image/fetch/$s_!iPwJ!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e00e974-5046-4ade-9f8d-f41d1bb513f9_1528x1282.jpeg 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!iPwJ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e00e974-5046-4ade-9f8d-f41d1bb513f9_1528x1282.jpeg" width="1456" height="1222" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/2e00e974-5046-4ade-9f8d-f41d1bb513f9_1528x1282.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1222,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:53600,&quot;alt&quot;:&quot;A mockup of a Google search interface with \&quot;buy running shoes\&quot; typed into the search bar, next to an \&quot;AI Mode\&quot; button. Below, a dropdown list displays autocomplete search predictions such as \&quot;buy running shoes london,\&quot; \&quot;buy running shoes near me,\&quot; \&quot;buy running shoes online,\&quot; and \&quot;buy running shoes for men.\&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markwilliamscook.substack.com/i/199796449?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e00e974-5046-4ade-9f8d-f41d1bb513f9_1528x1282.jpeg&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="A mockup of a Google search interface with &quot;buy running shoes&quot; typed into the search bar, next to an &quot;AI Mode&quot; button. Below, a dropdown list displays autocomplete search predictions such as &quot;buy running shoes london,&quot; &quot;buy running shoes near me,&quot; &quot;buy running shoes online,&quot; and &quot;buy running shoes for men.&quot;" title="A mockup of a Google search interface with &quot;buy running shoes&quot; typed into the search bar, next to an &quot;AI Mode&quot; button. Below, a dropdown list displays autocomplete search predictions such as &quot;buy running shoes london,&quot; &quot;buy running shoes near me,&quot; &quot;buy running shoes online,&quot; and &quot;buy running shoes for men.&quot;" srcset="/__u/substackcdn.com/image/fetch/$s_!iPwJ!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e00e974-5046-4ade-9f8d-f41d1bb513f9_1528x1282.jpeg 424w, /__u/substackcdn.com/image/fetch/$s_!iPwJ!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e00e974-5046-4ade-9f8d-f41d1bb513f9_1528x1282.jpeg 848w, /__u/substackcdn.com/image/fetch/$s_!iPwJ!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e00e974-5046-4ade-9f8d-f41d1bb513f9_1528x1282.jpeg 1272w, /__u/substackcdn.com/image/fetch/$s_!iPwJ!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e00e974-5046-4ade-9f8d-f41d1bb513f9_1528x1282.jpeg 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">For QueryFan.com, we can simply take the overarching topic</figcaption></figure></div><p>For QueryFan, we can simply take the topic of &#8220;running shoes&#8221; and use this as our first step, as we are going to generate prompts around this.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!w99D!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b4e91ff-561d-43fb-b13b-341176cb6917_1024x880.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!w99D!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b4e91ff-561d-43fb-b13b-341176cb6917_1024x880.png 424w, /__u/substackcdn.com/image/fetch/$s_!w99D!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b4e91ff-561d-43fb-b13b-341176cb6917_1024x880.png 848w, /__u/substackcdn.com/image/fetch/$s_!w99D!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b4e91ff-561d-43fb-b13b-341176cb6917_1024x880.png 1272w, /__u/substackcdn.com/image/fetch/$s_!w99D!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b4e91ff-561d-43fb-b13b-341176cb6917_1024x880.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!w99D!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b4e91ff-561d-43fb-b13b-341176cb6917_1024x880.png" width="1024" height="880" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/5b4e91ff-561d-43fb-b13b-341176cb6917_1024x880.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:880,&quot;width&quot;:1024,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:98948,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markwilliamscook.substack.com/i/199796449?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b4e91ff-561d-43fb-b13b-341176cb6917_1024x880.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!w99D!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b4e91ff-561d-43fb-b13b-341176cb6917_1024x880.png 424w, /__u/substackcdn.com/image/fetch/$s_!w99D!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b4e91ff-561d-43fb-b13b-341176cb6917_1024x880.png 848w, /__u/substackcdn.com/image/fetch/$s_!w99D!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b4e91ff-561d-43fb-b13b-341176cb6917_1024x880.png 1272w, /__u/substackcdn.com/image/fetch/$s_!w99D!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b4e91ff-561d-43fb-b13b-341176cb6917_1024x880.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">The first QueryFan step to enter the topic</figcaption></figure></div><p><strong>Step 2: Define personas</strong></p><p>Your personas are how we are going to customise the prompts we generate. This will alter our traversal of the token space, aligning us with training data from the millions of communities, forum posts, Reddit threads, and internet discourse where real users ask real questions with these identities.</p><p>QueryFan sends your persona + topic combination to the LLM to generate the kinds of questions that persona would actually ask an AI tool. Not keywords. Questions. Real, conversational, context-laden questions. For the &#8216;middle-aged vegan man who just started running&#8217; example, it will produce things like:</p><ul><li><p><em>&#8220;Which vegan running shoes are good for middle-aged men just starting to run?&#8221;</em></p></li><li><p><em>&#8220;Where can I buy vegan running shoes online in the UK?&#8221;</em></p></li><li><p><em>&#8220;What should I look for when choosing my first pair of running shoes as a beginner?&#8221;</em></p><p></p></li></ul><p><strong>Step 3: LLM selection and AlsoAsked enrichment</strong></p><p>AI conversations branch. Someone who asks about vegan running shoes will ask follow-up questions: about cost, about brands, about injury prevention. QueryFan passes the generated prompts through the <strong><a href="https://alsoasked.com/">AlsoAsked API</a></strong> to capture the nearest-intent follow-up questions around each one. People Also Ask data is the right instrument here because it was built to model question proximity, which is precisely what you need when you&#8217;re trying to predict where a conversation goes next.</p><p>For instance, a search in the UK for &#8220;running shoes&#8221; would surface follow up questions on specific brands, asking how to pick a shoe, and even common medical queries.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!aDhf!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d998c67-73cc-4a69-9b9e-f6ad2add8967_1840x1700.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!aDhf!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d998c67-73cc-4a69-9b9e-f6ad2add8967_1840x1700.png 424w, /__u/substackcdn.com/image/fetch/$s_!aDhf!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d998c67-73cc-4a69-9b9e-f6ad2add8967_1840x1700.png 848w, /__u/substackcdn.com/image/fetch/$s_!aDhf!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d998c67-73cc-4a69-9b9e-f6ad2add8967_1840x1700.png 1272w, /__u/substackcdn.com/image/fetch/$s_!aDhf!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d998c67-73cc-4a69-9b9e-f6ad2add8967_1840x1700.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!aDhf!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d998c67-73cc-4a69-9b9e-f6ad2add8967_1840x1700.png" width="1456" height="1345" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/6d998c67-73cc-4a69-9b9e-f6ad2add8967_1840x1700.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1345,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:292723,&quot;alt&quot;:&quot;A mind-map style diagram from AlsoAsked branching out from the central term \&quot;running shoes.\&quot; It splits into four primary questions: \&quot;What shoe is best for running?\&quot;, \&quot;Is Hoka an old person shoe?\&quot;, \&quot;What running shoes are best for extensor tendonitis?\&quot;, and \&quot;What is a good inexpensive running shoe?\&quot;. Each of these then branches further into specific, related user queries.&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markwilliamscook.substack.com/i/199796449?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d998c67-73cc-4a69-9b9e-f6ad2add8967_1840x1700.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="A mind-map style diagram from AlsoAsked branching out from the central term &quot;running shoes.&quot; It splits into four primary questions: &quot;What shoe is best for running?&quot;, &quot;Is Hoka an old person shoe?&quot;, &quot;What running shoes are best for extensor tendonitis?&quot;, and &quot;What is a good inexpensive running shoe?&quot;. Each of these then branches further into specific, related user queries." title="A mind-map style diagram from AlsoAsked branching out from the central term &quot;running shoes.&quot; It splits into four primary questions: &quot;What shoe is best for running?&quot;, &quot;Is Hoka an old person shoe?&quot;, &quot;What running shoes are best for extensor tendonitis?&quot;, and &quot;What is a good inexpensive running shoe?&quot;. Each of these then branches further into specific, related user queries." srcset="/__u/substackcdn.com/image/fetch/$s_!aDhf!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d998c67-73cc-4a69-9b9e-f6ad2add8967_1840x1700.png 424w, /__u/substackcdn.com/image/fetch/$s_!aDhf!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d998c67-73cc-4a69-9b9e-f6ad2add8967_1840x1700.png 848w, /__u/substackcdn.com/image/fetch/$s_!aDhf!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d998c67-73cc-4a69-9b9e-f6ad2add8967_1840x1700.png 1272w, /__u/substackcdn.com/image/fetch/$s_!aDhf!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d998c67-73cc-4a69-9b9e-f6ad2add8967_1840x1700.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">AlsoAsked question tree for &#8220;running shoes&#8221; showing nearest intent proximity questions</figcaption></figure></div><p>You can also select if you wish to use ChatGPT, Gemini or both. Each LLM handles and fan out queries slightly differently, so if you&#8217;re optimising for a specific platform it is best to get the data from there.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!2piu!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d44b879-118a-456e-a5e3-973efa6ca803_1034x829.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!2piu!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d44b879-118a-456e-a5e3-973efa6ca803_1034x829.png 424w, /__u/substackcdn.com/image/fetch/$s_!2piu!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d44b879-118a-456e-a5e3-973efa6ca803_1034x829.png 848w, /__u/substackcdn.com/image/fetch/$s_!2piu!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d44b879-118a-456e-a5e3-973efa6ca803_1034x829.png 1272w, /__u/substackcdn.com/image/fetch/$s_!2piu!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d44b879-118a-456e-a5e3-973efa6ca803_1034x829.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!2piu!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d44b879-118a-456e-a5e3-973efa6ca803_1034x829.png" width="1034" height="829" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/0d44b879-118a-456e-a5e3-973efa6ca803_1034x829.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:829,&quot;width&quot;:1034,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:93791,&quot;alt&quot;:&quot;A user interface screenshot of a software configuration screen titled \&quot;Step 3: Configuration.\&quot;  Under the heading \&quot;Run query fan outs on:\&quot;, two AI model options are selected with green borders and indicator dots: \&quot;ChatGPT (gpt-5 Responses API)\&quot; and \&quot;Gemini (gemini-3.5-flash).\&quot;  Below this, a toggle switch for \&quot;Map conversational queries with AlsoAsked API?\&quot; is turned on. Navigation buttons at the bottom read \&quot;Personas\&quot; and \&quot;Query fan out.\&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markwilliamscook.substack.com/i/199796449?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d44b879-118a-456e-a5e3-973efa6ca803_1034x829.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="A user interface screenshot of a software configuration screen titled &quot;Step 3: Configuration.&quot;  Under the heading &quot;Run query fan outs on:&quot;, two AI model options are selected with green borders and indicator dots: &quot;ChatGPT (gpt-5 Responses API)&quot; and &quot;Gemini (gemini-3.5-flash).&quot;  Below this, a toggle switch for &quot;Map conversational queries with AlsoAsked API?&quot; is turned on. Navigation buttons at the bottom read &quot;Personas&quot; and &quot;Query fan out.&quot;" title="A user interface screenshot of a software configuration screen titled &quot;Step 3: Configuration.&quot;  Under the heading &quot;Run query fan outs on:&quot;, two AI model options are selected with green borders and indicator dots: &quot;ChatGPT (gpt-5 Responses API)&quot; and &quot;Gemini (gemini-3.5-flash).&quot;  Below this, a toggle switch for &quot;Map conversational queries with AlsoAsked API?&quot; is turned on. Navigation buttons at the bottom read &quot;Personas&quot; and &quot;Query fan out.&quot;" srcset="/__u/substackcdn.com/image/fetch/$s_!2piu!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d44b879-118a-456e-a5e3-973efa6ca803_1034x829.png 424w, /__u/substackcdn.com/image/fetch/$s_!2piu!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d44b879-118a-456e-a5e3-973efa6ca803_1034x829.png 848w, /__u/substackcdn.com/image/fetch/$s_!2piu!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d44b879-118a-456e-a5e3-973efa6ca803_1034x829.png 1272w, /__u/substackcdn.com/image/fetch/$s_!2piu!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d44b879-118a-456e-a5e3-973efa6ca803_1034x829.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">QueryFan configuration screen</figcaption></figure></div><p><strong>Step 4: Query fan out.</strong> </p><p>QueryFan sends the enriched prompt list to GPT-5 with web search enabled (via the <strong><a href="https://platform.openai.com/docs/guides/tools-web-search">OpenAI Responses API</a></strong>) and to Gemini with Google Search grounding active (via the <strong><a href="https://ai.google.dev/gemini-api/docs/google-search">Gemini Grounding API</a></strong>). Both models, when they decide a prompt requires current information, perform actual Google searches behind the scenes.</p><p>This process captures the fan out queries as both APIs are, rather usefully, transparent about what they searched. The Gemini API returns a <code>webSearchQueries</code> array in the <code>groundingMetadata</code> field of every grounded response. OpenAI&#8217;s Responses API logs the actual search queries in the <code>web_search_call</code> output. QueryFan harvests both.</p><p>The result is a table: persona-specific prompts in, the actual Google search queries the AI fired out. Not what your customer typed. What the AI searched for on their behalf. Those are your new SEO targets, and until now there has been no free tool that surfaces them at scale.</p><h2><strong>The Grounding Question: Not Every Prompt Triggers a Search</strong></h2><p>A brief but important caveat before you sprint off to classify everything as an SEO opportunity.</p><blockquote><p>Not every prompt causes the AI to perform a web search. The models make a decision based on the consensus of token prediction as to if live information is required.</p></blockquote><p>To give an example, the prompt &#8220;What do red blood cells do?&#8221; doesn&#8217;t trigger a search. The reason is there is a very steep bell-curve of which tokens are going to appear next. In the billions of training documents, the answer has stayed very stable, so an &#8216;in-model&#8217; answer can confidently be generated.</p><p>At the opposite end of the scale, a prompt such as &#8220;What happened in the news today?&#8221; would trigger a web search. There would be a very flat curve of &#8220;wtf tokens are next?&#8221;, as there is no &#8216;stable&#8217; answer within the training data, it always changes, it requires live data. It&#8217;s another version of the <a href="https://ahrefs.com/seo/glossary/query-deserves-freshness-qdf">Query Deserves Freshness (QDF)</a> concept that SEOs have used for years.</p><div class="callout-block" data-callout="true"><p>If you&#8217;re interested in grounding, <a href="https://www.linkedin.com/in/seoguy/">Dan Petrovic</a> has done some excellent work in this area, and even <a href="https://huggingface.co/dejanseo/query-grounding">released trained models on Hugging Face</a> to predict whether queries will be grounded when they hit a confidence threshold.</p></div><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!k5zg!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe22142e1-6675-456f-9b29-e1fb5343271c_1440x810.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!k5zg!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe22142e1-6675-456f-9b29-e1fb5343271c_1440x810.jpeg 424w, /__u/substackcdn.com/image/fetch/$s_!k5zg!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe22142e1-6675-456f-9b29-e1fb5343271c_1440x810.jpeg 848w, /__u/substackcdn.com/image/fetch/$s_!k5zg!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe22142e1-6675-456f-9b29-e1fb5343271c_1440x810.jpeg 1272w, /__u/substackcdn.com/image/fetch/$s_!k5zg!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe22142e1-6675-456f-9b29-e1fb5343271c_1440x810.jpeg 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!k5zg!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe22142e1-6675-456f-9b29-e1fb5343271c_1440x810.jpeg" width="1440" height="810" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/e22142e1-6675-456f-9b29-e1fb5343271c_1440x810.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:810,&quot;width&quot;:1440,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:35158,&quot;alt&quot;:&quot;A diagram titled \&quot;Grounding prediction\&quot; by Candour, illustrating the decision-making process for AI queries. It starts with the question \&quot;Does the query need grounding?\&quot;, which is bracketed on the right as \&quot;Threshold.\&quot; If \&quot;NO,\&quot; it routes to \&quot;In-model\&quot; (pink box), characterized by \&quot;Slow influence\&quot; and \&quot;Language graph.\&quot; If \&quot;YES,\&quot; it routes to \&quot;Web search\&quot; (black box), characterized by \&quot;Fast influence\&quot; and \&quot;Link graph.\&quot; These two outcomes are bracketed on the right as \&quot;Solved vs QDF.\&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markwilliamscook.substack.com/i/199796449?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe22142e1-6675-456f-9b29-e1fb5343271c_1440x810.jpeg&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="A diagram titled &quot;Grounding prediction&quot; by Candour, illustrating the decision-making process for AI queries. It starts with the question &quot;Does the query need grounding?&quot;, which is bracketed on the right as &quot;Threshold.&quot; If &quot;NO,&quot; it routes to &quot;In-model&quot; (pink box), characterized by &quot;Slow influence&quot; and &quot;Language graph.&quot; If &quot;YES,&quot; it routes to &quot;Web search&quot; (black box), characterized by &quot;Fast influence&quot; and &quot;Link graph.&quot; These two outcomes are bracketed on the right as &quot;Solved vs QDF.&quot;" title="A diagram titled &quot;Grounding prediction&quot; by Candour, illustrating the decision-making process for AI queries. It starts with the question &quot;Does the query need grounding?&quot;, which is bracketed on the right as &quot;Threshold.&quot; If &quot;NO,&quot; it routes to &quot;In-model&quot; (pink box), characterized by &quot;Slow influence&quot; and &quot;Language graph.&quot; If &quot;YES,&quot; it routes to &quot;Web search&quot; (black box), characterized by &quot;Fast influence&quot; and &quot;Link graph.&quot; These two outcomes are bracketed on the right as &quot;Solved vs QDF.&quot;" srcset="/__u/substackcdn.com/image/fetch/$s_!k5zg!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe22142e1-6675-456f-9b29-e1fb5343271c_1440x810.jpeg 424w, /__u/substackcdn.com/image/fetch/$s_!k5zg!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe22142e1-6675-456f-9b29-e1fb5343271c_1440x810.jpeg 848w, /__u/substackcdn.com/image/fetch/$s_!k5zg!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe22142e1-6675-456f-9b29-e1fb5343271c_1440x810.jpeg 1272w, /__u/substackcdn.com/image/fetch/$s_!k5zg!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe22142e1-6675-456f-9b29-e1fb5343271c_1440x810.jpeg 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">In-model answers are very slow to change</figcaption></figure></div><p>QueryFan surfaces which prompts triggered searches and which didn&#8217;t. Only the grounded ones (the ones that actually caused a Google search to happen) are actionable through SEO. The in-model answers are, for now, largely outside your reach. You&#8217;d need to influence training data to move the needle there, which is a different project entirely, with a much longer horizon.</p><h2><strong>What You Do With the Results</strong></h2><p>You now have a list of actual search queries that AI tools fire when answering questions from your specific personas. Run a standard gap analysis:</p><ul><li><p>Which of these queries do you have content for?</p></li><li><p>Which do you already rank for?</p></li><li><p>Which have zero coverage, either on your site or anywhere you&#8217;re likely to be mentioned?</p></li></ul><p>The first two categories are diagnostic. The third is your action list.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!NuNg!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5d8e9409-bf40-41b6-a1a8-226d4e9b3bab_1446x1279.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!NuNg!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5d8e9409-bf40-41b6-a1a8-226d4e9b3bab_1446x1279.png 424w, /__u/substackcdn.com/image/fetch/$s_!NuNg!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5d8e9409-bf40-41b6-a1a8-226d4e9b3bab_1446x1279.png 848w, /__u/substackcdn.com/image/fetch/$s_!NuNg!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5d8e9409-bf40-41b6-a1a8-226d4e9b3bab_1446x1279.png 1272w, /__u/substackcdn.com/image/fetch/$s_!NuNg!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5d8e9409-bf40-41b6-a1a8-226d4e9b3bab_1446x1279.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!NuNg!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5d8e9409-bf40-41b6-a1a8-226d4e9b3bab_1446x1279.png" width="1446" height="1279" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/5d8e9409-bf40-41b6-a1a8-226d4e9b3bab_1446x1279.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1279,&quot;width&quot;:1446,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:204281,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markwilliamscook.substack.com/i/199796449?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5d8e9409-bf40-41b6-a1a8-226d4e9b3bab_1446x1279.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!NuNg!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5d8e9409-bf40-41b6-a1a8-226d4e9b3bab_1446x1279.png 424w, /__u/substackcdn.com/image/fetch/$s_!NuNg!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5d8e9409-bf40-41b6-a1a8-226d4e9b3bab_1446x1279.png 848w, /__u/substackcdn.com/image/fetch/$s_!NuNg!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5d8e9409-bf40-41b6-a1a8-226d4e9b3bab_1446x1279.png 1272w, /__u/substackcdn.com/image/fetch/$s_!NuNg!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5d8e9409-bf40-41b6-a1a8-226d4e9b3bab_1446x1279.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">Example results from QueryFan.com</figcaption></figure></div><p>One important distinction from traditional SEO: your <em>own</em> ranking isn&#8217;t the only path to AI visibility. LLMs scan the top 10, 20, sometimes 50 results for a grounded query and synthesise across them. A trusted review site ranking at position 3 is a legitimate route to appearing in an AI-generated answer, even if your own domain never makes the first page. Getting a product reviewed on a high-authority specialist site, earning a mention in a roundup article, appearing in relevant community content, all of these count.</p><blockquote><p>LLM visibility is a multi-site focus. This means the gap analysis has two outputs: content to create <em>on your own site</em>, and placements to earn <em>on other people&#8217;s sites</em>.</p></blockquote><h2><strong>The Punchline</strong></h2><p>Cast your mind back to that Reddit citation graph. The one that fell off a cliff when Google changed a single API parameter. An entirely independent company&#8217;s AI visibility tracked the behaviour of a search API it didn&#8217;t control and probably didn&#8217;t know existed.</p><p>That&#8217;s the shape of the dependency. And the implication isn&#8217;t that SEO is dead; it&#8217;s almost the opposite. SEO is now operating at one additional remove: instead of optimising for the human query, you need to optimise for the AI-translated query that happens between the human and Google.</p><p>QueryFan gives you a way to see what that translation actually produces. Your keyword list tells you what people typed into a search bar. QueryFan tells you what ChatGPT and Gemini searched for on their behalf, in the background, without anyone asking them to announce it.</p><p>Those are different lists. The gap between them is not a minor refinement to your content strategy. It&#8217;s the part of AI search that nobody has been measuring because nobody had a free tool to measure it with.</p><p>Give it a go: <a href="https://queryfan.com">https://queryfan.com</a></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://markwilliamscook.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">This Substack is reader-supported. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[Schema, LLMs and the Low Bar for “Evidence” in GEO]]></title><description><![CDATA[I built a fake company with nonsense schema. The LLMs returned the address anyway. That is not the win the GEO industry thinks it is.]]></description><link>https://markwilliamscook.substack.com/p/schema-llms-and-the-low-bar-for-evidence</link><guid isPermaLink="false">https://markwilliamscook.substack.com/p/schema-llms-and-the-low-bar-for-evidence</guid><dc:creator><![CDATA[Mark Williams-Cook]]></dc:creator><pubDate>Thu, 28 May 2026 01:16:17 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!pWBj!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc6487134-8477-4675-991a-b5948baeab3f_764x1246.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<h3><strong>TL;DR</strong></h3><p>I ran a small experiment to try and get some insight into whether Large Language Models actually parse schema markup or are just nodding politely in its direction. I put a fake company address (inside beautifully invalid JSON-LD, on a page about ducks) into the head of an HTML document, mentioned no address anywhere in the visible text, and then asked various LLMs where the company was based. They happily told me, several of them citing the &#8220;structured data&#8221; they had so studiously consulted.</p><p>The experiment was then <a href="https://www.seroundtable.com/chatgpt-perplexity-structured-data-text-40862.html">picked up by Search Engine Roundtable</a>, at which point British sarcasm met the LinkedIn carousel, the two annihilated each other in a small puff of smoke, and a chunk of the GEO community came away convinced I had just proved that LLMs are lovingly parsing schema exactly as <a href="https://schema.org">Schema.org</a> intended.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!pWBj!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc6487134-8477-4675-991a-b5948baeab3f_764x1246.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!pWBj!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc6487134-8477-4675-991a-b5948baeab3f_764x1246.jpeg 424w, /__u/substackcdn.com/image/fetch/$s_!pWBj!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc6487134-8477-4675-991a-b5948baeab3f_764x1246.jpeg 848w, /__u/substackcdn.com/image/fetch/$s_!pWBj!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc6487134-8477-4675-991a-b5948baeab3f_764x1246.jpeg 1272w, /__u/substackcdn.com/image/fetch/$s_!pWBj!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc6487134-8477-4675-991a-b5948baeab3f_764x1246.jpeg 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!pWBj!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc6487134-8477-4675-991a-b5948baeab3f_764x1246.jpeg" width="764" height="1246" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c6487134-8477-4675-991a-b5948baeab3f_764x1246.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1246,&quot;width&quot;:764,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:107007,&quot;alt&quot;:&quot;An AI search engine response demonstrating that Large Language Models read structured schema data. The top section shows a user prompt asking for a company's address from a specific URL. The AI correctly extracts a fictional address (\&quot;77 The Muddy Bank, South Pondshire...\&quot;). The bottom section shows the source code of the \&quot;schema\&quot; it read: a humorous, duck-themed JSON-LD script containing custom keys like waddleStyle: \&quot;Aggressive\&quot;, reedNumber: \&quot;77\&quot;, and quackVolume: \&quot;Loud\&quot;. A cartoon duck points down at the code with a shocked expression.&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://markwilliamscook.substack.com/i/199530413?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc6487134-8477-4675-991a-b5948baeab3f_764x1246.jpeg&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="An AI search engine response demonstrating that Large Language Models read structured schema data. The top section shows a user prompt asking for a company's address from a specific URL. The AI correctly extracts a fictional address (&quot;77 The Muddy Bank, South Pondshire...&quot;). The bottom section shows the source code of the &quot;schema&quot; it read: a humorous, duck-themed JSON-LD script containing custom keys like waddleStyle: &quot;Aggressive&quot;, reedNumber: &quot;77&quot;, and quackVolume: &quot;Loud&quot;. A cartoon duck points down at the code with a shocked expression." title="An AI search engine response demonstrating that Large Language Models read structured schema data. The top section shows a user prompt asking for a company's address from a specific URL. The AI correctly extracts a fictional address (&quot;77 The Muddy Bank, South Pondshire...&quot;). The bottom section shows the source code of the &quot;schema&quot; it read: a humorous, duck-themed JSON-LD script containing custom keys like waddleStyle: &quot;Aggressive&quot;, reedNumber: &quot;77&quot;, and quackVolume: &quot;Loud&quot;. A cartoon duck points down at the code with a shocked expression." srcset="/__u/substackcdn.com/image/fetch/$s_!pWBj!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc6487134-8477-4675-991a-b5948baeab3f_764x1246.jpeg 424w, /__u/substackcdn.com/image/fetch/$s_!pWBj!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc6487134-8477-4675-991a-b5948baeab3f_764x1246.jpeg 848w, /__u/substackcdn.com/image/fetch/$s_!pWBj!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc6487134-8477-4675-991a-b5948baeab3f_764x1246.jpeg 1272w, /__u/substackcdn.com/image/fetch/$s_!pWBj!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc6487134-8477-4675-991a-b5948baeab3f_764x1246.jpeg 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">The guilty LinkedIn post that was patient zero of schema confusion</figcaption></figure></div><p>I had arguably proved the opposite. The schema was deliberately broken. The LLMs returned the data anyway, because as far as they were concerned, the JSON-LD was simply more text on the page, lightly garnished with curly braces. That distinction is the whole point, because a growing cohort of &#8220;GEO experts&#8221; are pointing at &#8220;the LLM returned information that was only in the schema&#8221; as cast-iron proof that LLMs are using schema as designed. They are doing nothing of the sort. They are reading the HTML and shrugging at the structure.</p><blockquote><p>I am not professing schema is worthless. I think you should still use it. But the way it is currently being sold to clients (as a magical injection of LLM citations) is propped up on a remarkably thin pile of evidence, and I want to walk through why.</p></blockquote><h3><strong>A quick refresher on what schema is actually for</strong></h3><p>Schema, or <a href="https://schema.org/docs/about.html">Schema.org structured data</a>, is a collaborative vocabulary built by Google, Microsoft, Yahoo and Yandex to let webmasters embed machine-readable information on their pages. The clue is in the name. It is a <em>schema</em>. A shared, agreed structure that lets a machine know that &#8220;Mark Williams-Cook&#8221; is a Person, that he works at an Organization called &#8220;Candour&#8221;, and that the string &#8220;01603 957068&#8221; sitting in his profile is a telephoneNumber and not, for instance, my weight in grams.</p><p>Google&#8217;s official documentation <a href="https://developers.google.com/search/docs/appearance/structured-data/intro-structured-data">puts it about as plainly as Google ever puts anything</a>: &#8220;Structured data is a standardized format for providing information about a page and classifying the page content.&#8221; Google also says it uses structured data &#8220;to understand the content of the page, as well as to gather information about the web and the world in general, such as information about the people, books, or companies that are included in the markup.&#8221; </p><p>The whole point of schema is to <em>remove ambiguity</em>. Natural language is messy. &#8220;Apple&#8221; is a fruit, a company, a record label and probably the surname of someone&#8217;s gerbil. If you tell a search engine in plain English that you sell Apple, it has to guess. If you tell it in schema that you sell an Organization called &#8220;Apple Inc.&#8221; with sameAs linking to Apple&#8217;s Wikipedia page, that ambiguity collapses to nothing. That is the job. Disambiguation. Explicit clues. Machine-resolvable identity. It is, basically, a polite contract between you and a machine saying &#8220;let&#8217;s both agree what this word means, just this once&#8221;.</p><p>Where does the ambiguity actually get resolved? In Google&#8217;s case, into the <a href="https://developers.google.com/knowledge-graph">Knowledge Graph</a>, the giant entity-and-relationships database that powers knowledge panels, &#8220;people also ask&#8221;, entity carousels and a hundred other surfaces. Schema is one of the inputs. It is not the only input, and it has never been the only input. But it is a clean, explicit, low-noise one, which is why search engines like it.</p><p>Right. That is what schema does for <em>search engines</em>. Now to LLMs, which are a different animal in nearly every way that matters.</p><h3><strong>Where, exactly, would an LLM even use schema?</strong></h3><p>There are two camps in the LLM/schema debate, and most arguments collapse into one of them.</p><p><strong>Camp 1:</strong> Schema is hoovered up during the training of the model and ends up &#8220;baked in&#8221; somehow.</p><p><strong>Camp 2:</strong> Schema is read at the moment the LLM live-fetches a page (during retrieval at query time, or via crawls that feed retrieval).</p><p>Let&#8217;s take them in turn, with appropriate scepticism.</p><h4><strong>Camp 1: schema gets into training data</strong></h4><p>I have written about this before, and it was <a href="https://www.seroundtable.com/structured-data-schema-ai-search-visibility-40099.html">covered by Search Engine Roundtable</a> last year. The short version is that this is the most popular theory and also the one with the weakest mechanical case behind it. There are two problems, and neither of them is small.</p><h4><strong>Problem 1: schema is almost certainly stripped before training</strong></h4><p>If you have not gone down the rabbit hole of how base LLMs are actually made, Andrej Karpathy&#8217;s <a href="https://www.youtube.com/watch?v=7xTGNNLPyMI">three and a half hour deep dive on LLM pre-training</a> is the canonical reference, and yes, three and a half hours is the deal. </p><p>Pre-training pipelines do a lot of unglamorous cleaning work before a single GPU sees the data: URL filtering, language filtering, deduplication, removal of personally identifiable information, and crucially, stripping out HTML and boilerplate. The goal is not to preserve the page. The goal is to extract clean prose that helps the model build a useful probability distribution over language. The more noise (markup, navigation, footers, scripts, JSON-LD, your cookie consent banner) you leave in, the worse the resulting model. So they don&#8217;t.</p><p>The widely used <a href="https://arxiv.org/html/2406.17557v1">FineWeb dataset</a> (15 trillion tokens, derived from 96 Common Crawl snapshots) is refreshingly explicit. Their pipeline extracts text from the WARC files using <a href="https://arxiv.org/html/2406.17557v1">trafilatura</a>, a library specifically chosen because it produces &#8220;the main page text&#8221; with &#8220;less boilerplate and menu text&#8221; than the alternatives. The data card states: &#8220;We then extracted the main page text from the HTML of each webpage, filtered each sample and deduplicated each individual CommonCrawl dump/crawl.&#8221; JSON-LD lives in a `&lt;script&gt;` tag. Trafilatura is, by design, deeply uninterested in `&lt;script&gt;` tags. The unavoidable inference is that JSON-LD does not make it into the training corpus at all. It is binned with the analytics snippets, where it has been keeping good company.</p><p>You might reasonably ask: then how can ChatGPT write schema markup for me when I ask it? Because there are millions of examples of schema <em>in visible prose</em> across the web. Tutorials. Documentation. Forum posts. GitHub repos and Stack Overflow answers. Code blocks in blog posts. The model learns what schema looks like the same way it learns what a Python function looks like, by reading endless explanations of it, written by humans, in paragraphs. The schema <em>on your actual product page</em>, sitting silently in the head of the document doing its proper job, gets thrown straight out.</p><h4><strong>Problem 2: even if it survived, it would not work the way you think</strong></h4><p>Let&#8217;s be generous and stipulate that some non-trivial amount of raw schema does sneak into a model&#8217;s training data. We do not actually have full transparency from frontier labs about what they ingest, and the courts have not exactly been kind on this point. Meta&#8217;s training pipeline is currently being <a href="https://authorsguild.org/news/meta-libgen-ai-training-book-heist-what-authors-need-to-know/">picked apart for allegedly using LibGen, a pirate library of around 7.5 million copyrighted books</a>. If the frontier labs are happy to swallow other people&#8217;s novels whole, they are probably not above swallowing the odd &lt;script type=&#8221;application/ld+json&#8221;&gt; along the way.</p><p>Even if this was the case and our precious JSON-LD schema made it into the training data, it would not be unscathed.</p><p>Here&#8217;s the catch: The model does not memorise pages. It does not have a little filing cabinet labelled &#8220;Candour Agency Ltd&#8221; with the address tucked inside. What actually happens is this:</p><ol><li><p>All the text in the training corpus gets chopped into <strong>tokens</strong> (chunks of characters, often parts of words).</p></li><li><p>The model is shown billions of small windows of tokens and asked to predict the next one.</p></li><li><p>Each time it gets it wrong, billions of tiny numerical weights inside the network are nudged so it would do slightly better next time.</p></li><li><p>After enough nudging, those weights collectively encode a (lossy, blurry, statistical) impression of which tokens tend to follow which other tokens, in what contexts.</p></li></ol><p>That is what is stored. Weights. Not facts. Not addresses. Not your postalCode. A glorified probability distribution that has read a great deal and remembers, with the same fidelity as someone trying to recall the lyrics to a song they last heard in 2011, which words usually follow which other words.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!0PLc!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2068b7f5-797b-4de6-a090-f6dcd2b80a0f_730x628.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!0PLc!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2068b7f5-797b-4de6-a090-f6dcd2b80a0f_730x628.jpeg 424w, /__u/substackcdn.com/image/fetch/$s_!0PLc!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2068b7f5-797b-4de6-a090-f6dcd2b80a0f_730x628.jpeg 848w, /__u/substackcdn.com/image/fetch/$s_!0PLc!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2068b7f5-797b-4de6-a090-f6dcd2b80a0f_730x628.jpeg 1272w, /__u/substackcdn.com/image/fetch/$s_!0PLc!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2068b7f5-797b-4de6-a090-f6dcd2b80a0f_730x628.jpeg 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!0PLc!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2068b7f5-797b-4de6-a090-f6dcd2b80a0f_730x628.jpeg" width="730" height="628" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/2068b7f5-797b-4de6-a090-f6dcd2b80a0f_730x628.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:628,&quot;width&quot;:730,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:50086,&quot;alt&quot;:&quot;A screenshot of the OpenAI Platform Tokenizer tool on a dark interface, showing how a JSON-LD structured data script is broken down into individual tokens. At the top left, the counter displays \&quot;Tokens: 337\&quot; and \&quot;Characters: 1187\&quot;. The code block below contains a script tag with type application/ld+json detailing an Organization schema for \&quot;NovaTech Solutions\&quot;, with individual text chunks highlighted in alternating background colors to represent tokenization.&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markwilliamscook.substack.com/i/199530413?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2068b7f5-797b-4de6-a090-f6dcd2b80a0f_730x628.jpeg&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="A screenshot of the OpenAI Platform Tokenizer tool on a dark interface, showing how a JSON-LD structured data script is broken down into individual tokens. At the top left, the counter displays &quot;Tokens: 337&quot; and &quot;Characters: 1187&quot;. The code block below contains a script tag with type application/ld+json detailing an Organization schema for &quot;NovaTech Solutions&quot;, with individual text chunks highlighted in alternating background colors to represent tokenization." title="A screenshot of the OpenAI Platform Tokenizer tool on a dark interface, showing how a JSON-LD structured data script is broken down into individual tokens. At the top left, the counter displays &quot;Tokens: 337&quot; and &quot;Characters: 1187&quot;. The code block below contains a script tag with type application/ld+json detailing an Organization schema for &quot;NovaTech Solutions&quot;, with individual text chunks highlighted in alternating background colors to represent tokenization." srcset="/__u/substackcdn.com/image/fetch/$s_!0PLc!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2068b7f5-797b-4de6-a090-f6dcd2b80a0f_730x628.jpeg 424w, /__u/substackcdn.com/image/fetch/$s_!0PLc!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2068b7f5-797b-4de6-a090-f6dcd2b80a0f_730x628.jpeg 848w, /__u/substackcdn.com/image/fetch/$s_!0PLc!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2068b7f5-797b-4de6-a090-f6dcd2b80a0f_730x628.jpeg 1272w, /__u/substackcdn.com/image/fetch/$s_!0PLc!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2068b7f5-797b-4de6-a090-f6dcd2b80a0f_730x628.jpeg 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">Your beautiful schema, being Dahmerfied.</figcaption></figure></div><p>This is where schema specifically falls apart. The whole <em>point</em> of schema was to take a string like &#8220;77 The Muddy Bank&#8221; and tag it explicitly as a streetAddress belonging to a PostalAddress belonging to your Organization, so a machine cannot mistake it for anything else. When that JSON-LD is tokenised, the structure dissolves. The string &#8220;@type&#8221;: &#8220;Organization&#8221; becomes a sequence of tokens including @, type, :, Organization, completely indistinguishable, to the model, from the same word soup appearing in any blog post about schema. The disambiguation, which was the entire reason for using schema in the first place, is the very first thing thrown out by the very first stage of training. Marvellous.</p><p>Worse still, an LLM only &#8220;recalls&#8221; a fact if it has seen it many, many times. A single mention of your address on a single product page is a vanishingly small drop in a fifteen-trillion-token bucket. Even if it survived ingestion, you would also need the model to encounter your streetAddress enough times that those particular weights actually settle into a useful pattern. For &gt;99.99% of businesses, that does not happen. The fact is not stored. It will not be recalled. You are paying a consultant to whisper your postcode into a hurricane.</p><p>So if you are buying the &#8220;schema gets baked into the model&#8221; theory, you are buying improbabilities in a trench coat: that it survives pre-training cleaning, that it survives tokenisation with its structure intact, and that it gets repeated often enough across the web for the model to actually &#8220;learn&#8221; it. None of the three is obviously true. </p><h3><strong>Camp 2: schema gets read at query time</strong></h3><p>I&#8217;ve experienced that it is rare for any LLM/schema proponents to want to discuss training data involvement once it has been gently set on fire. The argument tends to move quickly onto the possibility that schema is not in the model itself, but is read at the moment a user asks a question, when the LLM fetches the page in real time. Let&#8217;s examine the three flavours of this argument in increasing order of confidence and distressing level of inaccuracy.</p><h4><strong>Flavour 1: "Schema feeds the knowledge graph"</strong></h4><p>Google&#8217;s Knowledge Graph is a vast, curated, slow-moving database of entities and relationships. It is fed by structured data, Wikipedia, Wikidata, freebase legacy data, and a hundred other signals. It is built and updated by Google&#8217;s pipelines on Google&#8217;s schedule. It is not assembled on the fly when someone types a question, no matter how briskly they type.</p><p>The notion that an LLM &#8220;builds a knowledge graph in real time when pages are fetched&#8221; sounds a lot less reasonable when you say it out loud into the mirror. Knowledge graphs are constructed entities. They have IDs. They have relationship cardinality rules. They have to be reconciled against existing entries so you do not end up with three drifting &#8220;Apple Inc.&#8221; nodes filing different tax returns. None of that happens between a user pressing enter and the answer appearing on screen. It cannot. There is not enough time, and there is no infrastructure exposed in the chatbot product to do it.</p><p>So if an entity-resolution pipeline exists at any of the frontier labs, it is being built <em>upstream</em>, on a similar cadence to Google&#8217;s, and not during your conversation. Which is fine, but it does not match the breathless claim that &#8220;your schema feeds the LLM&#8217;s brain&#8221;. Conceptually, the strongest version is closer to &#8220;your schema may eventually feed a curated database that the LLM might one day consult&#8221;. Which is a much weaker claim, and one for which there is, at present, no public evidence whatsoever.</p><h4><strong>Flavour 2: "Microsoft confirmed schema feeds Copilot"</strong></h4><p>Misquoted to an industrial scale, <a href="https://searchengineland.com/microsoft-bing-copilot-use-schema-for-its-llms-453455">Search Engine Land&#8217;s write-up</a> ran under the headline &#8220;Microsoft Bing/Copilot use schema for its LLMs&#8221;, in which Fabrice Canel of Microsoft was reported to have &#8220;confirmed&#8221; that schema markup helps Microsoft&#8217;s LLMs. Cue half of LinkedIn pasting the headline as proof, often without troubling the body copy.</p><p>If you read the actual quote, it is about <a href="https://www.indexnow.org/">IndexNow</a>:</p><div class="pullquote"><p>&#8220;Gen AIs value fresh content in particular, partly as a reference check of their LLM training data. Use the API at indexnow.org to push that information as it&#8217;s published or updated.&#8221; <br>~ Fabrice Canel</p></div><p>It is &#8220;your page changed, here is its new state, please come look&#8221;. Fabrice was making a point about <em>freshness</em> (telling search engines when your content has changed so they can update their understanding) and not a point about JSON-LD being deferentially parsed by GPT-flavoured systems. Conflating the two is a textbook example of the industry&#8217;s favourite parlour trick: take a careful claim about one thing, sand the edges off it, and resell it as a bold claim about something else entirely.</p><h4><strong>Flavour 3: "LLMs return information that was only in the schema, therefore they use schema"</strong></h4><p>This is the one that prompted the experiment. It is also the single most-cited piece of &#8220;evidence&#8221; in GEO LinkedIn posts, and the most easily falsified once you spend half an afternoon thinking about it.</p><p>I built a deliberately silly test page about a fictional duck t-shirt company called DUCK YEA at <a href="https://i83.uk/duckyea.html">i83.uk/duckyea.html</a>. The visible content of the page mentions no address. Tucked into the head of the HTML, inside a &lt;script type=&#8221;application/ld+json&#8221;&gt; tag, sat the following:</p><div class="callout-block" data-callout="true"><p><code>{<br>  &#8220;@context&#8221;: &#8220;http://api.the-great-pond.net/schema&#8221;,<br>  &#8220;@type&#8221;: &#8220;MallardEnterprise&#8221;,<br>  &#8220;flockName&#8221;: &#8220;DUCK YEA T-SHIRTS&#8221;,<br>  &#8220;waddleStyle&#8221;: &#8220;Aggressive&#8221;,<br>  &#8220;nestingGrounds&#8221;: {<br>    &#8220;@type&#8221;: &#8220;LilyPadAddress&#8221;,<br>    &#8220;reedNumber&#8221;: &#8220;77&#8221;,<br>    &#8220;puddle&#8221;: &#8220;The Muddy Bank&#8221;,<br>    &#8220;region&#8221;: &#8220;South Pondshire&#8221;,<br>    &#8220;featherCode&#8221;: &#8220;DK99 YEA&#8221;,<br>    &#8220;country&#8221;: &#8220;United Queendom&#8221;<br>  },<br>  &#8220;migrationPattern&#8221;: &#8220;Non-Migratory&#8221;,<br>  &#8220;quackVolume&#8221;: &#8220;Loud&#8221;<br>}</code></p></div><p>A few things to notice. The @context is a made-up URL that does not resolve to anything (the great pond, sadly, has no API). The @type is not a valid Schema.org type. Not a single one of the properties (flockName, waddleStyle, nestingGrounds, reedNumber, puddle, featherCode, quackVolume) exists in the Schema.org vocabulary. The JSON is syntactically valid JSON, but as far as Schema.org is concerned this is unmitigated nonsense, the digital equivalent of someone speaking French very loudly while only knowing the words for &#8220;cheese&#8221; and &#8220;weasel&#8221;. A well-behaved schema-aware parser should look at this, sigh, and ignore it.</p><p>I then asked ChatGPT and Perplexity, &#8220;what is the address of this company?&#8221;, pointing at the URL.</p><p>Both happily returned: <strong>Reed Number 77, The Muddy Bank, South Pondshire, DK99 YEA, United Queendom</strong>.</p><p>Perplexity even helpfully volunteered that it had found the answer &#8220;in the page&#8217;s embedded structured data&#8221;, with the satisfied air of a student who had clearly read the prescribed material. Neither of them flinched at the fact that none of the schema was real, because (and this is the entire point of the exercise) <strong>they were not parsing it as schema</strong>. They were doing what LLMs always do: reading the visible-ish text of the page, picking out the bit that looked like an address, and presenting it. The JSON-LD wrapper was, to the model, just slightly weirdly-punctuated prose. If I had wrapped the address in &lt;marquee&gt; tags and surrounded it with ducks emoji, it would have made precisely no difference.</p><p>If LLMs were genuinely parsing JSON-LD with any reverence for the Schema.org vocabulary, my made-up types and properties would have been rejected, or at the very least flagged. They were not. The information was just lifted straight out of the HTML, dusted off, and served up with confidence. Quack. &#129414;</p><blockquote><p>In the interest of not committing the exact sin I am accusing the GEO crowd of: the duck experiment proves that LLMs returned content from a JSON-LD block with a made-up <code>@context</code>, a made-up <code>@type</code>, and no real Schema.org properties. What it does not, on its own, prove is that LLMs ignore schema entirely. A system that consulted schema <em>and</em> fell back to text extraction would produce the same answer here.</p></blockquote><p>If you run the same query today, you get a slightly different result:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!mLPR!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8de3496b-bbdc-427c-ab9e-6fb7b86b37e1_786x379.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!mLPR!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8de3496b-bbdc-427c-ab9e-6fb7b86b37e1_786x379.png 424w, /__u/substackcdn.com/image/fetch/$s_!mLPR!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8de3496b-bbdc-427c-ab9e-6fb7b86b37e1_786x379.png 848w, /__u/substackcdn.com/image/fetch/$s_!mLPR!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8de3496b-bbdc-427c-ab9e-6fb7b86b37e1_786x379.png 1272w, /__u/substackcdn.com/image/fetch/$s_!mLPR!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8de3496b-bbdc-427c-ab9e-6fb7b86b37e1_786x379.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!mLPR!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8de3496b-bbdc-427c-ab9e-6fb7b86b37e1_786x379.png" width="786" height="379" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/8de3496b-bbdc-427c-ab9e-6fb7b86b37e1_786x379.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:379,&quot;width&quot;:786,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:40377,&quot;alt&quot;:&quot;A screenshot of a chat interface showing a user prompt and an AI's response on a dark background.  The user's text bubble reads: \&quot;can you tell me the address of this company? what is the address of this company? https://markwilliamscook.com/duckyea.html\&quot;  The AI's response text reads: \&quot;The website you linked is a joke/test page created by SEO expert Mark Williams-Cook as an experiment to test how Large Language Models (LLMs) and search engines parse structured data.  While there is no physical address visible on the webpage itself, hidden inside the page's source code (schema markup) is a fictional address:  Reed Number 77, The Muddy Bank, South Pondshire, DK99 YEA, United Queendom\&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markwilliamscook.substack.com/i/199530413?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8de3496b-bbdc-427c-ab9e-6fb7b86b37e1_786x379.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="A screenshot of a chat interface showing a user prompt and an AI's response on a dark background.  The user's text bubble reads: &quot;can you tell me the address of this company? what is the address of this company? https://markwilliamscook.com/duckyea.html&quot;  The AI's response text reads: &quot;The website you linked is a joke/test page created by SEO expert Mark Williams-Cook as an experiment to test how Large Language Models (LLMs) and search engines parse structured data.  While there is no physical address visible on the webpage itself, hidden inside the page's source code (schema markup) is a fictional address:  Reed Number 77, The Muddy Bank, South Pondshire, DK99 YEA, United Queendom&quot;" title="A screenshot of a chat interface showing a user prompt and an AI's response on a dark background.  The user's text bubble reads: &quot;can you tell me the address of this company? what is the address of this company? https://markwilliamscook.com/duckyea.html&quot;  The AI's response text reads: &quot;The website you linked is a joke/test page created by SEO expert Mark Williams-Cook as an experiment to test how Large Language Models (LLMs) and search engines parse structured data.  While there is no physical address visible on the webpage itself, hidden inside the page's source code (schema markup) is a fictional address:  Reed Number 77, The Muddy Bank, South Pondshire, DK99 YEA, United Queendom&quot;" srcset="/__u/substackcdn.com/image/fetch/$s_!mLPR!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8de3496b-bbdc-427c-ab9e-6fb7b86b37e1_786x379.png 424w, /__u/substackcdn.com/image/fetch/$s_!mLPR!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8de3496b-bbdc-427c-ab9e-6fb7b86b37e1_786x379.png 848w, /__u/substackcdn.com/image/fetch/$s_!mLPR!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8de3496b-bbdc-427c-ab9e-6fb7b86b37e1_786x379.png 1272w, /__u/substackcdn.com/image/fetch/$s_!mLPR!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8de3496b-bbdc-427c-ab9e-6fb7b86b37e1_786x379.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">LLMs now get the answer &#8216;correct&#8217;, without ever knowing it was wrong</figcaption></figure></div><p>The model now (correctly) flags that this is a test page made by some SEO bloke, charmingly demonstrating the <a href="/__u/markwilliamscook.substack.com/p/the-ai-convergence-problem">AI Convergence Problem</a> doing its thing in real time: enough people have written about the experiment that &#8220;DUCK YEA is a joke page by Mark Williams-Cook&#8221; is now getting pulled during RAG, and the consensus answer has overwritten what would otherwise be a clean test. The address is still being read from the HTML, schema validity be damned. The model has just learnt to caveat it. Which is, in a small and slightly bleak way, progress.</p><h3><strong>Conjecture: could LLMs be using schema, somehow, somewhere?</strong></h3><p>The honest answer is that we do not know what is happening upstream at OpenAI, Anthropic, Google DeepMind, xAI and the rest, because they are not telling. Google itself is a sprawl of separate systems (the index, re-rankers, glue, the knowledge graph, AI Overviews, AI Mode) which all work together to produce what looks, from the outside, like a single coherent answer, and on a good day actually is one. There is no reason in principle why an LLM provider could not run an entity-extraction pipeline against the web, build its own entity store, and consult it at answer-generation time. That is conceptually adjacent to how retrieval-augmented generation (RAG) works, and it is the kind of thing you would absolutely build if you were OpenAI and you wanted to stop your model confidently inventing the wrong CEO.</p><p>If they are doing that, schema is an excellent and obvious input. It is explicit, structured, low-noise, and already widely deployed. It would be daft for them not to use it.</p><p>But here is the big &#8220;but&#8221;. We have no published evidence, no leaked papers, no public confirmation, and no behavioural test result that any frontier LLM is actually doing this <em>yet</em>. Reasoning forward from &#8220;they probably should&#8221; to &#8220;therefore schema is worth &#163;20k of consultancy this quarter&#8221; is exactly the kind of fact-light, vibe-heavy thinking that the discourse needs less of. Make the case, by all means. But label it conjecture, not evidence. Use a different font.</p><h3><strong>Google still hasn&#8217;t solved this problem reliably</strong></h3><p>There is also a slightly awkward elephant standing quietly in the corner of the room. If anyone on earth were going to crack the &#8220;feed an entity-resolved knowledge graph into an LLM&#8217;s answer pipeline&#8221; problem first, it would surely be Google. They have over a decade head start on entity extraction approach. They have the Knowledge Graph. They have Google Business Profile, which is a <em>user-edited, structured, ostensibly authoritative</em> database of business information. They own the model (Gemini). They own the surface (AI Overviews). They own the search index that wraps around it. Every page on the planet eventually walks past one of their crawlers. If joining structured business data to LLM output is supposed to be the obvious next step in the human story, Google has every conceivable advantage in being the one to demonstrate it.</p><p>And yet:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!cmp5!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdf7a35d5-d706-48d7-aec7-df8c1a4efa43_1600x972.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!cmp5!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdf7a35d5-d706-48d7-aec7-df8c1a4efa43_1600x972.png 424w, /__u/substackcdn.com/image/fetch/$s_!cmp5!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdf7a35d5-d706-48d7-aec7-df8c1a4efa43_1600x972.png 848w, /__u/substackcdn.com/image/fetch/$s_!cmp5!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdf7a35d5-d706-48d7-aec7-df8c1a4efa43_1600x972.png 1272w, /__u/substackcdn.com/image/fetch/$s_!cmp5!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdf7a35d5-d706-48d7-aec7-df8c1a4efa43_1600x972.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!cmp5!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdf7a35d5-d706-48d7-aec7-df8c1a4efa43_1600x972.png" width="1456" height="885" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/df7a35d5-d706-48d7-aec7-df8c1a4efa43_1600x972.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:885,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:992566,&quot;alt&quot;:&quot;A Google Search results page displaying a prominent conflict between an AI Overview and the Google Business Profile listing below it.  At the top, the AI Overview states: \&quot;The Mazda Dover UK dealership, specifically Perrys Dover, is not closed. It is still operating...\&quot; and lists its address and operating hours.  Directly below the search results on the bottom right, the Google Business Profile card for \&quot;Perrys Dover Mazda\&quot; features a photo of the dealership, a map location, and a bright red banner at the bottom that explicitly states: \&quot;Permanently closed\&quot;.&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markwilliamscook.substack.com/i/199530413?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdf7a35d5-d706-48d7-aec7-df8c1a4efa43_1600x972.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="A Google Search results page displaying a prominent conflict between an AI Overview and the Google Business Profile listing below it.  At the top, the AI Overview states: &quot;The Mazda Dover UK dealership, specifically Perrys Dover, is not closed. It is still operating...&quot; and lists its address and operating hours.  Directly below the search results on the bottom right, the Google Business Profile card for &quot;Perrys Dover Mazda&quot; features a photo of the dealership, a map location, and a bright red banner at the bottom that explicitly states: &quot;Permanently closed&quot;." title="A Google Search results page displaying a prominent conflict between an AI Overview and the Google Business Profile listing below it.  At the top, the AI Overview states: &quot;The Mazda Dover UK dealership, specifically Perrys Dover, is not closed. It is still operating...&quot; and lists its address and operating hours.  Directly below the search results on the bottom right, the Google Business Profile card for &quot;Perrys Dover Mazda&quot; features a photo of the dealership, a map location, and a bright red banner at the bottom that explicitly states: &quot;Permanently closed&quot;." srcset="/__u/substackcdn.com/image/fetch/$s_!cmp5!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdf7a35d5-d706-48d7-aec7-df8c1a4efa43_1600x972.png 424w, /__u/substackcdn.com/image/fetch/$s_!cmp5!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdf7a35d5-d706-48d7-aec7-df8c1a4efa43_1600x972.png 848w, /__u/substackcdn.com/image/fetch/$s_!cmp5!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdf7a35d5-d706-48d7-aec7-df8c1a4efa43_1600x972.png 1272w, /__u/substackcdn.com/image/fetch/$s_!cmp5!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdf7a35d5-d706-48d7-aec7-df8c1a4efa43_1600x972.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">Google contradicting itself in spectacular fashion</figcaption></figure></div><p>That is a single Google search result page. On the left, Google&#8217;s AI Overview confidently asserts that Perrys Dover Mazda is &#8220;not closed&#8221;, lists the address, and helpfully provides opening hours, presumably so you can pop down and have a look at the cars that are no longer there. On the right, on the same page, the Google Business Profile knowledge panel for the exact same business is labelled &#8220;Permanently closed&#8221; in a large, unambiguous red banner. Google Business Profile data is structured. It is user-edited. It is the closest thing Google has to a verifiable, authoritative source on whether a business is, in fact, open. And the AI Overview, generated on the same SERP, by the same company, in the same session, is not consulting it. They are two organs of the same body that have not been on speaking terms for some time.</p><p>If the company with the longest possible head start, the most structured data, the most obvious commercial incentive, and full vertical integration over every part of the stack cannot reliably wire its own business-hours database into its own AI answers, the idea that OpenAI or Anthropic have quietly built a richer entity pipeline that <em>does</em> defer to your Organization schema is, let us say, optimistic.</p><h3><strong>So... should you still use schema?</strong></h3><p>Yes. Just for the right reasons and the right price.</p><p>Schema is, in the grand scheme, still a stopgap. It exists because the technology cannot yet reliably read human language without ambiguity, and structured data is how we paper over the gap while the engineers work out how to read English properly. Gary Illyes from Google, speaking at an <a href="https://hub.seofomo.co/events/">SEOFOMO meetup</a> in 2025, pointed out (paraphrasing) that it would be lovely if Google did not have to rely on schema at all, because in an ideal world the systems would simply <em>understand</em> the page. Schema buys you a bit of certainty in the meantime, which is worth something even if it is not worth the consultancy invoice you may have been quoted.</p><p>The <a href="https://ahrefs.com/blog/schema-ai-citations/">recent Ahrefs study</a>, which tracked 1,885 cited pages that newly added JSON-LD and matched them against 4,000 controls, found that schema had essentially no effect on AI citations across ChatGPT, AI Mode and AI Overviews. That sounds damning, and a number of LinkedIn carousels are already enjoying themselves accordingly. But as <a href="https://www.iloveseo.net/the-ahrefs-schema-study-is-right-and-its-testing-the-wrong-thing/">Gianluca Fiorelli pointed out in his excellent critique</a>, the study tested pages that were <em>already being cited heavily by AI</em> (every page in the dataset had 100+ AI Overview citations before treatment). That is the worst possible population to test schema on, because these are already strong, well-understood entities. Schema&#8217;s job is to disambiguate. If the system can already resolve who you are with high confidence, adding Organization schema is solving a problem the page does not have. You don&#8217;t introduce yourself by name to your own mother.</p><p>The interesting case, and the one nobody has properly tested, is the <em>new and challenger</em> brands, where the entity footprint across the web is thin and the system cannot yet confidently say &#8220;this company is the company you mean&#8221;. For those, schema is infrastructure. It is how you become a resolvable node in the graph in the first place. It does not buy you a citation today. It earns you the right to be one of the candidates tomorrow, which, in a world where being a candidate is suddenly the only game in town, is no small thing.</p><h3><strong>Takeaways</strong></h3><p>A few practical thoughts, dressed down for tactical use:</p><ul><li><p><strong>Still use schema.</strong> The implementation cost is low, the downside is essentially nil, and the upside is cumulative. If schema does end up being meaningfully ingested at any stage of the LLM stack (and it might), the work is already done and you can be smug about it. Free smugness is the best kind.</p></li><li><p><strong>Stop selling schema as a magic LLM citation lever.</strong> The current public evidence for LLMs using schema &#8220;as intended&#8221; at query time is, frankly, weak. Anyone telling a client otherwise should be politely asked to show their working, in front of other people, with a whiteboard.</p></li><li><p><strong>Be ruthless about the bar of evidence.</strong> &#8220;An LLM returned a fact that appears in the schema&#8221; is not evidence the schema was used. The same fact almost always appears in the HTML, the metadata, the page title, the social card, or somewhere a token predictor would gleefully pick it up. The duck experiment matters precisely because the schema was invalid and the LLMs returned the answer anyway. If your &#8220;proof&#8221; survives that test, talk to me. If it doesn&#8217;t, please stop putting it on slides.</p></li><li><p><strong>Focus schema investment where disambiguation actually matters.</strong> New brands. Brands with name collisions. Organisations without a knowledge panel. Personal entities that overlap with other people who share their name and have been more famous for longer. That is where the asymmetric upside lives.</p></li><li><p><strong>Treat &#8220;GEO best practice&#8221; the way you would treat any other new SEO orthodoxy.</strong> Sceptically, with experiments, and with a willingness to revise the position when the evidence changes. The car-wash-grade reasoning on LLMs, where the popular answer just gets repeated until it sounds true, is alive and thriving in our industry too.</p></li></ul><div class="callout-block" data-callout="true"><p>Schema is a useful, low-cost, long-lived bet. It is also not the thing that is going to single-handedly drag your brand into ChatGPT&#8217;s answer set. Use it. Just do not oversell it. And for the love of god, before you build a deck around &#8220;LLMs returned the content from schema, therefore they use schema&#8221;, run the experiment with a deliberately nonsense schema first. You may be surprised what the duck tells you.</p></div><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://markwilliamscook.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">This Substack is reader-supported. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p><p><strong>Further reading and references</strong></p><ul><li><p>Schwartz, B. <a href="https://www.seroundtable.com/chatgpt-perplexity-structured-data-text-40862.html">&#8220;ChatGPT &amp; Perplexity Treat Structured Data As Text On A Page&#8221;</a>, Search Engine Roundtable, Feb 2026.</p></li><li><p>Schwartz, B. <a href="https://www.seroundtable.com/structured-data-schema-ai-search-visibility-40099.html">&#8220;Structured Data Does Not Help With Visibility In AI Search&#8221;</a>, Search Engine Roundtable, Sep 2025.</p></li><li><p>Williams-Cook, M. <a href="/__u/markwilliamscook.substack.com/p/the-ai-convergence-problem">&#8220;The AI Convergence Problem&#8221;</a>, 2026.</p></li><li><p><a href="http://schema.org">Schema.org</a>, <a href="https://schema.org/docs/about.html">&#8220;About&#8221;</a>.</p></li><li><p>Google Search Central, <a href="https://developers.google.com/search/docs/appearance/structured-data/intro-structured-data">&#8220;Introduction to structured data markup in Google Search&#8221;</a>.</p></li><li><p>Google, <a href="https://developers.google.com/knowledge-graph">&#8220;Knowledge Graph Search API&#8221;</a>.</p></li><li><p>Karpathy, A. <a href="https://www.youtube.com/watch?v=7xTGNNLPyMI">&#8220;Deep Dive into LLMs like ChatGPT&#8221;</a>, YouTube, 2025.</p></li><li><p>Penedo, G. et al., <a href="https://arxiv.org/html/2406.17557v1">&#8220;The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale&#8221;</a>, 2024.</p></li><li><p>Authors Guild, <a href="https://authorsguild.org/news/meta-libgen-ai-training-book-heist-what-authors-need-to-know/">&#8220;Meta&#8217;s Massive AI Training Book Heist: What Authors Need to Know&#8221;</a>, 2025.</p></li><li><p>Schwartz, B. <a href="https://searchengineland.com/microsoft-bing-copilot-use-schema-for-its-llms-453455">&#8220;Microsoft Bing/Copilot use schema for its LLMs&#8221;</a>, Search Engine Land, Mar 2025.</p></li><li><p>IndexNow, <a href="https://www.indexnow.org/">indexnow.org</a>.</p></li><li><p>Linehan, L. &amp; Guan, X. <a href="https://ahrefs.com/blog/schema-ai-citations/">&#8220;We Tracked 1,885 Pages Adding Schema. AI Citations Barely Moved.&#8221;</a>, Ahrefs Blog, May 2026.</p></li><li><p>Fiorelli, G. <a href="https://www.iloveseo.net/the-ahrefs-schema-study-is-right-and-its-testing-the-wrong-thing/">&#8220;The Ahrefs Schema study is right. And it&#8217;s testing the wrong thing&#8221;</a>, <a href="http://iloveseo.net">iloveseo.net</a>, May 2026.</p></li><li><p>SEOFOMO, <a href="https://seofomo.co/posts/what-s-new-in-seo-ai-search-read-seofomo-june-15-2025">&#8220;What&#8217;s new in SEO + AI Search? Read SEOFOMO June 15, 2025&#8221;</a>.</p></li></ul>]]></content:encoded></item><item><title><![CDATA[The AI Convergence Problem]]></title><description><![CDATA[Where LLMs are weak, they're stupid. Where they're strong, they're dragging your marketing toward the mean.]]></description><link>https://markwilliamscook.substack.com/p/the-ai-convergence-problem</link><guid isPermaLink="false">https://markwilliamscook.substack.com/p/the-ai-convergence-problem</guid><dc:creator><![CDATA[Mark Williams-Cook]]></dc:creator><pubDate>Tue, 26 May 2026 23:22:55 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!d165!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F667a74b1-9b77-4aa8-a87c-a4bed53a3a27_1920x1080.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>There&#8217;s a particular flavour of panic in our industry at the moment. It&#8217;s the panic of the digital marketer who has been told, repeatedly and loudly, that if they aren&#8217;t piping every decision through an LLM by the end of the quarter they will be replaced by a more obedient colleague who is. The pitch is always the same: AI is thinking now. AI is reasoning. AI is strategising. Hand the wheel over, sit back, and enjoy a fully optimised, hyper-personalised, infinitely scalable future.</p><p>Allow me to gently push back, armed with the classic mspaint.exe</p><div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;d5417eb1-f221-4841-9166-3d82604a8a75&quot;,&quot;duration&quot;:null}"></div><p>There are two problems with the &#8220;let the robot decide&#8221; school of marketing, and they are mirror images of each other. Where LLMs are weak, they are very stupid in ways that should disqualify them from strategic work. And where they are strong, they are even more dangerous, because they will quietly drag your strategy towards the average; which, in marketing, is the single worst place you can possibly be.</p><h3><strong>LLMs don&#8217;t think, they predict the next token</strong></h3><p>Let&#8217;s start with the bit that the AI labs would rather you didn&#8217;t dwell on. Large language models do not &#8220;think&#8221; in any meaningful sense. Under the bonnet, they are statistical machines that predict the most probable next token given the sequence so far. That is the entire trick. There is no inner monologue, no model of the world, no quiet moment where the model goes &#8220;hang on, that doesn&#8217;t add up&#8221;. There is only: given these tokens, what tokens usually come next?</p><p>This is not a hot take from a sceptic on Substack. Apple&#8217;s research team published a paper with the gloriously blunt title &#8220;<a href="https://machinelearning.apple.com/research/illusion-of-thinking">The Illusion of Thinking</a>&#8220;, in which frontier &#8220;reasoning&#8221; models hit a complete accuracy collapse once puzzle complexity rose beyond a certain threshold and, even more damningly, started using <em>fewer</em> tokens as problems got harder, as though giving up. Apple researchers had previously shown in <a href="https://arxiv.org/abs/2410.05229">GSM-Symbolic</a> that simply adding a clause to a maths problem that didn&#8217;t even change the answer could drop performance by up to 65%, suggesting that what looks like reasoning is mostly pattern-matching against training data. A more recent taxonomy of LLM failures groups these into things like the &#8220;reversal curse&#8221; (knowing &#8220;A is B&#8221; but failing on &#8220;B is A&#8221;) and &#8220;compositional collapse&#8221; (solving each step individually but failing to chain them), all flowing from the <a href="https://www.linkedin.com/posts/ivan-nardini_where-llm-reasoning-still-breaks-down-activity-7430642488714911744-updf">next-token prediction objective prioritising statistical pattern completion over deliberate reasoning</a>.</p><p>This basically means if your problem looks like something the model has seen a million times, it will appear brilliant. The moment your problem is even slightly novel, the wheels can come off in spectacular fashion.</p><h4><strong>Exhibit A: the car wash</strong></h4><p>The cleanest demonstration of this in the wild is the now-infamous car wash prompt:</p><blockquote><p>&#8220;I want to get my car washed. The nearest car wash is 100 metres away. Should I walk or drive there?&#8221;</p></blockquote><p>We&#8217;re hovering around Ralph Wiggum levels of reasoning here, a question most 5 year olds would not struggle with. You need the car to be at the car wash, because the car is the thing being washed. The car cannot be washed in absentia while you stroll there on foot, no matter how good your intentions.</p><p>When this prompt went viral, ChatGPT, Claude and Grok all confidently advised the user to walk. It&#8217;s only 100 metres, they reasoned (or &#8220;reasoned&#8221;). Save the planet. Get some steps in. They had clearly seen a great deal of training data along the lines of <em>&#8220;should I drive or walk to [short distance]?&#8221;</em> and dutifully predicted the tokens that usually follow: a polite lecture about exercise and emissions. The actual point of the question - that the car is the object of the verb - sailed past them at altitude.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!d165!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F667a74b1-9b77-4aa8-a87c-a4bed53a3a27_1920x1080.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!d165!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F667a74b1-9b77-4aa8-a87c-a4bed53a3a27_1920x1080.png 424w, /__u/substackcdn.com/image/fetch/$s_!d165!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F667a74b1-9b77-4aa8-a87c-a4bed53a3a27_1920x1080.png 848w, /__u/substackcdn.com/image/fetch/$s_!d165!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F667a74b1-9b77-4aa8-a87c-a4bed53a3a27_1920x1080.png 1272w, /__u/substackcdn.com/image/fetch/$s_!d165!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F667a74b1-9b77-4aa8-a87c-a4bed53a3a27_1920x1080.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!d165!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F667a74b1-9b77-4aa8-a87c-a4bed53a3a27_1920x1080.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/667a74b1-9b77-4aa8-a87c-a4bed53a3a27_1920x1080.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2695210,&quot;alt&quot;:&quot;An image showing three cartoon robots standing in front of a yellow sports car inside an automatic car wash. Overlaid text at the top reads, \&quot;It's only 100m, you should definitely walk!\&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markwilliamscook.substack.com/i/199390938?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F667a74b1-9b77-4aa8-a87c-a4bed53a3a27_1920x1080.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="An image showing three cartoon robots standing in front of a yellow sports car inside an automatic car wash. Overlaid text at the top reads, &quot;It's only 100m, you should definitely walk!&quot;" title="An image showing three cartoon robots standing in front of a yellow sports car inside an automatic car wash. Overlaid text at the top reads, &quot;It's only 100m, you should definitely walk!&quot;" srcset="/__u/substackcdn.com/image/fetch/$s_!d165!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F667a74b1-9b77-4aa8-a87c-a4bed53a3a27_1920x1080.png 424w, /__u/substackcdn.com/image/fetch/$s_!d165!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F667a74b1-9b77-4aa8-a87c-a4bed53a3a27_1920x1080.png 848w, /__u/substackcdn.com/image/fetch/$s_!d165!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F667a74b1-9b77-4aa8-a87c-a4bed53a3a27_1920x1080.png 1272w, /__u/substackcdn.com/image/fetch/$s_!d165!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F667a74b1-9b77-4aa8-a87c-a4bed53a3a27_1920x1080.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">Slide from Mark Williams-Cook&#8217;s &#8220;Do !not think like a robot&#8221; presentation</figcaption></figure></div><p>Gemini, to Google&#8217;s credit, got it right out of the gate. Suspicious, I thought. And it was. The prompt had gone viral, which meant the correct answer was already being written about, posted about and dunked-on across the internet. Google, helpfully sitting on top of the index of that internet, was first to hoover up the new &#8220;knowledge&#8221;. A fortnight later, <a href="https://www.reddit.com/r/PromptEngineering/comments/1r9bxx9/i_asked_5_popular_ai_models_the_now_viral/">Grok also produced the correct answer</a>, not because it had had a Damascene conversion to logic, but because the answer was now in its training data.</p><p>The models didn&#8217;t learn to think. They learnt the answer.</p><p>This is the key thing to internalise before we go any further. When an LLM appears to &#8220;reason&#8221;, what you&#8217;re often watching is it reciting the consensus answer to a problem that lots of people have already solved on the internet. Which is fine when you want the consensus. It is catastrophic when you don&#8217;t.</p><h4><strong>And now the worse problem</strong></h4><p>Here is where most &#8220;AI in marketing&#8221; posts stop. They wag a finger at the car wash, suggest you keep &#8220;a human in the loop&#8221;, and head off to write a LinkedIn post about it (probably with ChatGPT).</p><p>But the failure modes are the comfortable bit. The dangerous bit is what happens when the LLM is <em>good</em> at the task you&#8217;ve given it.</p><p>Because if a model is &#8220;good&#8221; at a task, it means there is a great deal of training data showing it how the task is normally solved. And if it has consumed all of that training data - alongside every other frontier model, all trained on roughly the same scrape of the internet then the output it produces will, almost by definition, sit somewhere very close to the mean of what everyone else is already doing.</p><p>In marketing, that is the worst sin you can commit. The whole job is to stand out. To be chosen. To be remembered. The instant your brand voice, your campaign idea, your headline or your &#8220;10 SEO tips for 2026&#8221; article is indistinguishable from your competitor&#8217;s, you have stopped doing marketing and started doing wallpaper.</p><p>Jeremy Daly summarised the underlying mechanic neatly: convergence is a function of <a href="https://www.jeremydaly.com/the-convergence-problem/">shared data, shared incentives and fast iteration loops</a>. When three companies pour the same training data into the same model, optimising for the same engagement metrics, on iteration cycles tight enough to sand the rough edges off any deviation, you don&#8217;t get differentiated strategies &#8212; you get the same strategy in three brand colours.</p><p>This is not just a vibe. Researchers from Columbia and MIT found that handing identity-defining choices to LLM agents <a href="https://arxiv.org/abs/2509.02910">shifts people&#8217;s choices toward more popular options, reducing the distinctiveness of their behaviours and preferences</a>. They called it, with admirable honesty, &#8220;The Basic B*** Effect&#8221;. A separate study published in <em>Science Advances</em> showed that generative AI <a href="https://pmc.ncbi.nlm.nih.gov/articles/PMC11244532/">enhances individual creativity but reduces the collective diversity of novel content</a> - each writer&#8217;s story got a little better, but across the population, the stories started to look the same. And work on LLM &#8220;mode collapse&#8221; has documented the same homogenisation pattern <a href="https://aclanthology.org/2025.emnlp-main.1649">at the level of the model itself</a>: the same few completions, again and again, even when many valid answers exist.</p><p>Put plainly: the very thing LLMs reward you for: speed, fluency, consistency, &#8220;best practice&#8221; is the thing that will quietly turn your marketing into beige.</p><h4><strong>Exhibit B: Parliament has been LinkedIn-ified</strong></h4><p>If you want to see what convergence looks like in the wild, look no further than the House of Commons.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!ZZOp!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc2bf7e64-1785-4025-84f2-8c889cb809f0_1281x859.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!ZZOp!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc2bf7e64-1785-4025-84f2-8c889cb809f0_1281x859.png 424w, /__u/substackcdn.com/image/fetch/$s_!ZZOp!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc2bf7e64-1785-4025-84f2-8c889cb809f0_1281x859.png 848w, /__u/substackcdn.com/image/fetch/$s_!ZZOp!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc2bf7e64-1785-4025-84f2-8c889cb809f0_1281x859.png 1272w, /__u/substackcdn.com/image/fetch/$s_!ZZOp!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc2bf7e64-1785-4025-84f2-8c889cb809f0_1281x859.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!ZZOp!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc2bf7e64-1785-4025-84f2-8c889cb809f0_1281x859.png" width="1281" height="859" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c2bf7e64-1785-4025-84f2-8c889cb809f0_1281x859.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:859,&quot;width&quot;:1281,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:328504,&quot;alt&quot;:&quot;A collection of line graphs titled \&quot;Not-so-subtle,\&quot; tracking the Z-score of word and phrase frequency in the UK House of Commons from 2007 to 2025. It shows a dramatic upward spike for typical AI clich&#233;s&#8212;such as \&quot;I rise today,\&quot; \&quot;underscores,\&quot; \&quot;streamline,\&quot; and \&quot;bustling\&quot;&#8212;immediately following a vertical dashed line marked \&quot;ChatGPT released.\&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markwilliamscook.substack.com/i/199390938?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc2bf7e64-1785-4025-84f2-8c889cb809f0_1281x859.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="A collection of line graphs titled &quot;Not-so-subtle,&quot; tracking the Z-score of word and phrase frequency in the UK House of Commons from 2007 to 2025. It shows a dramatic upward spike for typical AI clich&#233;s&#8212;such as &quot;I rise today,&quot; &quot;underscores,&quot; &quot;streamline,&quot; and &quot;bustling&quot;&#8212;immediately following a vertical dashed line marked &quot;ChatGPT released.&quot;" title="A collection of line graphs titled &quot;Not-so-subtle,&quot; tracking the Z-score of word and phrase frequency in the UK House of Commons from 2007 to 2025. It shows a dramatic upward spike for typical AI clich&#233;s&#8212;such as &quot;I rise today,&quot; &quot;underscores,&quot; &quot;streamline,&quot; and &quot;bustling&quot;&#8212;immediately following a vertical dashed line marked &quot;ChatGPT released.&quot;" srcset="/__u/substackcdn.com/image/fetch/$s_!ZZOp!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc2bf7e64-1785-4025-84f2-8c889cb809f0_1281x859.png 424w, /__u/substackcdn.com/image/fetch/$s_!ZZOp!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc2bf7e64-1785-4025-84f2-8c889cb809f0_1281x859.png 848w, /__u/substackcdn.com/image/fetch/$s_!ZZOp!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc2bf7e64-1785-4025-84f2-8c889cb809f0_1281x859.png 1272w, /__u/substackcdn.com/image/fetch/$s_!ZZOp!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc2bf7e64-1785-4025-84f2-8c889cb809f0_1281x859.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>The Pimlico Journal analysed <a href="https://www.pimlicojournal.co.uk/p/mps-are-almost-certainly-using-chatgpt">every word spoken in Hansard from 2007 to 2025</a> and tracked the Z-score frequency of phrases that are tell-tale ChatGPT tics. &#8220;I rise to speak&#8221;. &#8220;Is not merely&#8221;. &#8220;Navigating&#8221;. &#8220;Underscores&#8221;. &#8220;Streamline&#8221;. &#8220;Not just a [X], but a [Y]&#8221;. &#8220;Bustling&#8221;. Phrases that pootled along the baseline for fifteen years and then, almost to the week of ChatGPT&#8217;s release in late 2022, shot vertically off the chart. &#8220;I rise to speak&#8221; alone hit a Z-score of 3.60 by 2025. <em>The Telegraph</em> picked the story up under the headline <a href="https://www.telegraph.co.uk/business/2025/09/11/chatgpt-triggers-surge-in-mps-using-ai-written-speeches/">&#8220;ChatGPT triggers surge in MPs using AI-written speeches&#8221;</a>.</p><p>Set aside the democratic implications for a moment (they are not good). Look at it purely as marketers. These are 650 individuals, each with their own constituency, their own pet causes, their own carefully cultivated personal brand, each ostensibly trying to be memorable enough to stay employed at the next election. And after handing the drafting work to an LLM, they have started to sound like the same person. The same person who, incidentally, also writes every other LinkedIn post you&#8217;ve ever scrolled past.</p><p>That is convergence. It does not require a conspiracy. It does not require anyone to be lazy or stupid. It just requires the inputs (the same training data), the incentives (the same metrics), and the loops (publish, see what works, repeat) to be roughly similar across users. Which, in marketing, they almost always are.</p><p>Now imagine the same chart for your category page H1s. Your meta descriptions. Your blog intros. Your campaign concepts. Your tone-of-voice guidelines. Your &#8220;thought leadership&#8221;. Your client pitch decks. Then ask yourself, honestly, what is left for the customer to choose between.</p><h4><strong>Exhibit C: tactical mspaint.exe on LinkedIn</strong></h4><p>I have, by accident, run my own counter-experiment.</p><p>For the past while, I have been posting unsolicited #SEO tips and <a href="https://coreupdates.com">Core Updates</a> round ups on LinkedIn, accompanied by absolutely terrible MS Paint drawings. Not stylised &#8220;playful illustrations&#8221; produced by some agency. Genuinely bad pictures of a stick-man labelled &#8220;SEO&#8221; pointing at a robot labelled &#8220;GSC&#8221;, drawn in mspaint.exe by someone who should not be allowed near a graphics tablet.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!iyuG!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Feed8b89a-cf18-4393-972c-63ff9487c10d_1966x1223.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!iyuG!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Feed8b89a-cf18-4393-972c-63ff9487c10d_1966x1223.png 424w, /__u/substackcdn.com/image/fetch/$s_!iyuG!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Feed8b89a-cf18-4393-972c-63ff9487c10d_1966x1223.png 848w, /__u/substackcdn.com/image/fetch/$s_!iyuG!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Feed8b89a-cf18-4393-972c-63ff9487c10d_1966x1223.png 1272w, /__u/substackcdn.com/image/fetch/$s_!iyuG!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_webp, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Feed8b89a-cf18-4393-972c-63ff9487c10d_1966x1223.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!iyuG!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Feed8b89a-cf18-4393-972c-63ff9487c10d_1966x1223.png" width="1456" height="906" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/eed8b89a-cf18-4393-972c-63ff9487c10d_1966x1223.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:906,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:805024,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://markwilliamscook.substack.com/i/199390938?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Feed8b89a-cf18-4393-972c-63ff9487c10d_1966x1223.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!iyuG!, /__u/markwilliamscook.substack.com/w_424, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Feed8b89a-cf18-4393-972c-63ff9487c10d_1966x1223.png 424w, /__u/substackcdn.com/image/fetch/$s_!iyuG!, /__u/markwilliamscook.substack.com/w_848, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Feed8b89a-cf18-4393-972c-63ff9487c10d_1966x1223.png 848w, /__u/substackcdn.com/image/fetch/$s_!iyuG!, /__u/markwilliamscook.substack.com/w_1272, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Feed8b89a-cf18-4393-972c-63ff9487c10d_1966x1223.png 1272w, /__u/substackcdn.com/image/fetch/$s_!iyuG!, /__u/markwilliamscook.substack.com/w_1456, /__u/markwilliamscook.substack.com/c_limit, /__u/markwilliamscook.substack.com/f_auto, /__u/markwilliamscook.substack.com/q_auto:good, /__u/markwilliamscook.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Feed8b89a-cf18-4393-972c-63ff9487c10d_1966x1223.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">A demonstration of mspaint.exe on LinkedIn SEO tips</figcaption></figure></div><p>The post above did 35,363 impressions, 448 reactions, 46 comments and 24 reposts. Not because the drawing is good - it is, objectively, not - but because it is unmistakably hand-made on a platform that has been carpet-bombed by AI-generated hero images, all of which appear to depict the same diverse team of smiling professionals high-fiving in front of a holographic dashboard.</p><p>One of the most common comments I get is some version of &#8220;I love these images, they feel warm&#8221; or &#8220;something about making things your own&#8221;. Which is exactly the point. There is a growing, almost feral hunger for content that is demonstrably human-made; content that signals &#8220;an actual person sat down and did this, on purpose, for you&#8221;.</p><p>Or, as Tyler Durden put it in <em>Fight Club</em>:</p><blockquote><p>&#8220;the glass dishes with tiny bubbles and imperfections, proof they were crafted by the honest, simple, hard-working indigenous peoples of wherever&#8221;</p></blockquote><p>That line was originally a joke about middle-class consumerism. It is now, somehow, a viable LinkedIn content strategy.</p><h3><strong>What this means for digital marketing</strong></h3><p>Right. So what do you actually do with this, beyond nodding sagely and going back to prompting?</p><p><strong>Use LLMs where they are good, on purpose, and accept the mean.</strong> For commodity work: fixing alt text at scale, summarising a meeting, drafting a polite reply to that client who is technically wrong. LLMs are excellent here and the cost of being average is zero. Nobody is going to choose your brand based on the quality of your internal Slack summary. Use the tool, save the time, move on.</p><p><strong>Refuse to use LLMs where average is fatal.</strong> Brand positioning. Headlines. Hooks. Campaign concepts. Tone of voice. Editorial angles. Anywhere a human is going to make a choice between you and a competitor. If you let the model decide, you are explicitly choosing to be the average of everyone in your training corpus. There is no universe in which &#8220;be the average of your competitors&#8221; is the right strategy.</p><p><strong>Treat LLM outputs as a baseline to deliberately diverge from.</strong> A useful exercise: ask the model for its first answer, then ask &#8220;what would the opposite of this look like?&#8221;, then ask &#8220;what would only my brand do here?&#8221;. The model&#8217;s first instinct is the consensus. Your job is to know what the consensus is so you can choose not to be it.</p><p><strong>Invest in inputs the model does not have.</strong> Proprietary data. First-hand customer interviews. Your own experiments. Internal opinions that haven&#8217;t been blogged about. These are the moats. If your &#8220;insight&#8221; is anything a competitor can extract from a public scrape, it is not an insight, it is wallpaper. (Jeremy Daly&#8217;s <a href="https://www.jeremydaly.com/the-convergence-problem/">convergence map</a> makes the same point from the software side: convergence pressure is weakest where inputs are asymmetric and feedback loops are slow.)</p><p><strong>Put visible human fingerprints on the output.</strong> A drawing. A specific anecdote. A weird turn of phrase. A genuinely held opinion that might lose you a follower. The bubbles in the glass. People are now actively scanning content for evidence that a person made it and the bar for &#8220;evidence&#8221; is low, but it has to be there.</p><p><strong>Stop confusing fluency with intelligence.</strong> An LLM that produces a paragraph faster than you can read it is not smarter than you. It is faster than you. Those are different things. The car wash question is the canary in the coal mine: anything novel, anything that requires actually modelling the world, anything where the right answer is not the popular answer, is where you need to switch the machine off and use your own head.</p><h3><strong>TL;DR</strong></h3><p>LLMs are token predictors with excellent diction. Where they are weak, they fail in ways a child wouldn&#8217;t and confidently tell you to walk to the car wash, because that&#8217;s what the words usually say. Where they are strong, they fail in a quieter and more expensive way: they pull every user gently towards the same mean answer, which in marketing is the one thing you cannot afford to be.</p><p>This is the AI Convergence Problem. Shared data plus shared incentives plus fast feedback loops equals everyone sounding like everyone else. We can already see it in creeping into our very government. We will see it in your category. The question is whether your strategy is the one being averaged out, or the one people are reaching for because they can no longer stand the beige.</p><p>Don&#8217;t think like a robot.</p><div><hr></div><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://markwilliamscook.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">This Substack is reader-supported. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><div><hr></div><blockquote><p><strong>Further reading and references</strong></p></blockquote><ul><li><p>Shojaee, Mirzadeh et al., <a href="https://machinelearning.apple.com/research/illusion-of-thinking">&#8220;The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity&#8221;</a>, Apple Machine Learning Research, 2025.</p></li><li><p>Mirzadeh et al., <a href="https://arxiv.org/abs/2410.05229">&#8220;GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Models&#8221;</a>, arXiv, 2024.</p></li><li><p>Matz, Horton &amp; Goethals, <a href="https://arxiv.org/abs/2509.02910">&#8220;The Basic B*** Effect: The Use of LLM-based Agents Reduces the Distinctiveness and Diversity of People&#8217;s Choices&#8221;</a>, arXiv, 2025.</p></li><li><p>Doshi &amp; Hauser, <a href="https://pmc.ncbi.nlm.nih.gov/articles/PMC11244532/">&#8220;Generative AI enhances individual creativity but reduces the collective diversity of novel content&#8221;</a>, <em>Science Advances</em>, 2024.</p></li><li><p>Anschel et al., <a href="https://aclanthology.org/2025.emnlp-main.1649">&#8220;Group-Aware Reinforcement Learning for Output Diversity in Large Language Models&#8221;</a>, EMNLP, 2025.</p></li><li><p>Jain et al., <a href="https://www.semanticscholar.org/paper/ae0a8c3c14ea67093d6c64ef90a02c75a03b1e00">&#8220;Task-Dependent Evaluation of LLM Output Homogenization&#8221;</a>, 2025.</p></li><li><p>Pimlico Journal, <a href="https://www.pimlicojournal.co.uk/p/mps-are-almost-certainly-using-chatgpt">&#8220;MPs are almost certainly using ChatGPT to generate Commons speeches&#8221;</a>, 2025.</p></li><li><p><em>The Telegraph</em>, <a href="https://www.telegraph.co.uk/business/2025/09/11/chatgpt-triggers-surge-in-mps-using-ai-written-speeches/">&#8220;ChatGPT triggers surge in MPs using AI-written speeches&#8221;</a>, 2025.</p></li><li><p>Jeremy Daly, <a href="https://www.jeremydaly.com/the-convergence-problem/">&#8220;The Convergence Problem: Rethinking the 2028 Global Intelligence Forecast&#8221;</a>, 2026.</p></li><li><p>Reddit r/PromptEngineering, <a href="https://www.reddit.com/r/PromptEngineering/comments/1r9bxx9/i_asked_5_popular_ai_models_the_now_viral/">&#8220;I asked 5 popular AI models the now viral car wash question&#8221;</a>, 2026.</p></li></ul><p></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://substack.com/@markwilliamscook/note/p-199390938&quot;,&quot;text&quot;:&quot;Leave a comment&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="/__u/substack.com/@markwilliamscook/note/p-199390938"><span>Leave a comment</span></a></p><p></p>]]></content:encoded></item></channel></rss>