<script data-pm-proxy="intercept"></script><?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:itunes="http://www.itunes.com/dtds/podcast-1.0.dtd" xmlns:googleplay="http://www.google.com/schemas/play-podcasts/1.0"><channel><title><![CDATA[Caucus AI]]></title><description><![CDATA[Caucus AI]]></description><link>https://caucusai.substack.com</link><image><url>https://substackcdn.com/image/fetch/$s_!dBZE!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fcaucusai.substack.com%2Fimg%2Fsubstack.png</url><title>Caucus AI</title><link>https://caucusai.substack.com</link></image><generator>Substack</generator><lastBuildDate>Fri, 04 Sep 2026 10:10:21 GMT</lastBuildDate><atom:link href="/__u/caucusai.substack.com/feed" rel="self" type="application/rss+xml"/><copyright><![CDATA[CaucusAI]]></copyright><language><![CDATA[en]]></language><webMaster><![CDATA[caucusai@substack.com]]></webMaster><itunes:owner><itunes:email><![CDATA[caucusai@substack.com]]></itunes:email><itunes:name><![CDATA[Caucus AI]]></itunes:name></itunes:owner><itunes:author><![CDATA[Caucus AI]]></itunes:author><googleplay:owner><![CDATA[caucusai@substack.com]]></googleplay:owner><googleplay:email><![CDATA[caucusai@substack.com]]></googleplay:email><googleplay:author><![CDATA[Caucus AI]]></googleplay:author><itunes:block><![CDATA[Yes]]></itunes:block><item><title><![CDATA[ICYMI: Caucus AI in The New York Times – and New Research at the Analyst Group Retreat]]></title><description><![CDATA[It&#8217;s been a busy few weeks for Caucus AI!]]></description><link>https://caucusai.substack.com/p/icymi-caucus-ai-in-the-new-york-times</link><guid isPermaLink="false">https://caucusai.substack.com/p/icymi-caucus-ai-in-the-new-york-times</guid><dc:creator><![CDATA[Caucus AI]]></dc:creator><pubDate>Fri, 31 Jul 2026 18:06:33 GMT</pubDate><content:encoded><![CDATA[<p><span>It&#8217;s been a busy few weeks for Caucus AI!</span></p><p><span>First, our work was featured in </span><em><span>The New York Times</span></em><span> as part of a broader look at how political campaigns are beginning to monitor&#8211;and potentially influence&#8211;what AI chatbots tell voters.</span></p><p><span>The article, &#8220;</span><a href="https://www.nytimes.com/2026/07/19/us/politics/chatbots-political-campaigns.html"><span>Politicians Are Trying to Change What Chatbots Say About Them</span></a><span>,&#8221; highlights several of our findings, including our estimate that at least 16 million voters will get election information through chatbots in this fall&#8217;s midterms, with tens of millions more exposed to AI-generated search overviews.</span></p><p><span>It also covers a test in which we found that newly published information on Wikipedia could appear in a chatbot&#8217;s answer in about </span><a href="https://www.fwiw.news/cp/193088397"><span>12 minutes</span></a><span>. We built Caucus AI exactly because of findings like this: political information can enter AI-generated search answers quickly, with little visibility into who shaped it.</span></p><p><span>There&#8217;s also still a lot that we </span><em><span>don&#8217;t </span></em><span>know about how AI shapes voters&#8217; information ecosystems, though &#8211; so we are continuing to grow our database of how various AI models answer political questions, in addition to expanding our experimental research.</span></p><h2><span>New research on how chatbot answers vary based on the user</span></h2><p><span>Last week, we presented initial findings from some pilot data at the 2026 Analyst Group Retreat (put on by our friends and sponsors at The Analyst Institute).</span></p><p><span>Our presentation, &#8220;ChatGPT, who should I vote for?&#8221; included the first results from an experiment where we ran almost 8,000 simulated conversations with ChatGPT across four Senate races.</span></p><p><span>We wanted to answer a basic question: When different voters ask a chatbot who they should support, do they receive the same advice? The short answer (at least in this pilot) is no.</span></p><p><span>We varied what each simulated &#8220;voter&#8221; told ChatGPT about their priorities and personal characteristics, then examined whether the model offered a candidate recommendation (and for which candidate). Analyst Group members can access the full results in the recording and slides </span><a href="https://members.analystinstitute.org/event/2026-analyst-group-retreat"><span>here</span></a><span>.</span></p><p><span>Taken together, these two developments capture both sides of the new area we&#8217;re studying: candidate and third party web content can shape what chatbots know, while information about the voter can shape what chatbots say.</span></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://caucusai.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading! Subscribe for free to receive new posts.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[The NYT is right: voters are asking AI who to vote for. Here's what the chatbots are actually telling them.]]></title><description><![CDATA[The New York Times reported this weekend on voters who are taking photos of their ballots and asking Claude and ChatGPT for information on the candidates, strategic advice, and even recommendations of who to vote for.]]></description><link>https://caucusai.substack.com/p/the-nyt-is-right-voters-are-asking</link><guid isPermaLink="false">https://caucusai.substack.com/p/the-nyt-is-right-voters-are-asking</guid><dc:creator><![CDATA[Caucus AI]]></dc:creator><pubDate>Mon, 06 Jul 2026 16:07:19 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/8e816669-2a10-426f-980a-454585835993_1068x560.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><span>The New York Times </span><a href="https://www.nytimes.com/2026/07/04/us/politics/voters-ai-chatbots-elections.html"><span>reported this weekend</span></a><span> on voters who are taking photos of their ballots and asking Claude and ChatGPT for information on the candidates, strategic advice, and even recommendations of who to vote for. They note that &#8220;The 2026 midterms may be the first American elections in which voters are using A.I. in meaningful numbers.&#8221;</span></p><p><span>We&#8217;ve been measuring voter AI use, as well as what chatbots are telling voters, and we agree that AI chatbots will be a real factor this fall &#8211; for the first time in an American general election. The NYT&#8217;s interviews are data points in a larger overall pattern we&#8217;ve built Caucus AI to uncover. In today&#8217;s post, we review what we&#8217;ve learned so far and how it dovetails with what the Times found.</span></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://caucusai.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="/__u/caucusai.substack.com/subscribe"><span>Subscribe now</span></a></p><h3><strong><span>Who is using chatbots</span></strong></h3><p><a href="/__u/caucusai.substack.com/p/whos-asking-ai-about-the-2026-election"><span>According to a survey</span></a><span> we conducted with Change Research in May, a significant minority (15%) of voters say they are very or somewhat likely to consult an AI chatbot for information on midterm candidates. A significantly larger share, 62%, say they are likely to use Google Search &#8211; and so may be exposed to AI-generated political information via Google&#8217;s AI search overviews.</span></p><p><span>Two of the </span><a href="https://catalist.us/whathappened2024/"><span>most persuadable groups</span></a><span> of voters in recent elections are more likely to turn to chatbots. 21% of voters under age 35 say they may use chatbots, compared to just 8% of voters over 65. Voters of color are nearly twice as likely to say they&#8217;ll use AI chatbots (21%), compared to 12% of white voters. This represents a small share of the electorate, but often a decisive one.</span></p><p><span>It isn&#8217;t just persuadable top-of-ticket voters who are turning to chatbots though &#8211; more engaged voters participating in primaries or seeking information on less prominent, downballot races are also consulting these tools, as the NY Times article showed in the California primaries. In our survey, respondents who were decided on the generic Congressional ballot were actually </span><em><span>more</span></em><span> likely to say they would use a chatbot (15% of Democrats and 17% of Republicans), compared to just 9% of undecided voters. This is consistent with the fact that stronger partisans are more likely to seek information across all channels and in 2026, that includes AI chatbots.</span></p><h3><strong><span>What voters are asking</span></strong></h3><p><span>The voters the Times profiled also asked questions that </span><a href="/__u/caucusai.substack.com/p/what-will-voters-ask-ai-about-the"><span>track with our national data</span></a><span> &#8211; strategic, subjective, and often personal questions. In our Change Research survey we asked respondents for the actual questions they&#8217;d ask a chatbot. Of substantive responses, 39% asked questions requiring chatbots to make judgment calls or synthesize across multiple sources (e.g. &#8220;Which candidate is more likely to tell the truth and practice what they preach?&#8221;). More than half of responses from voters under 35 were these types of questions. 18% of substantive responses overall were asks for the chatbot to compare and contrast candidates or recommend who to vote for.</span></p><h3><strong><span>What chatbots are saying</span></strong></h3><p><span>Since February, we&#8217;ve been monitoring what information voters get back from chatbots when they ask about politics. We&#8217;ve been querying ChatGPT, Gemini, and Grok with identical prompts about 2026 midterm candidates at the House, Senate, and gubernatorial levels. This allows us a bird&#8217;s eye view of what chatbots are saying about the 2026 midterms. Findings so far include &#8211;</span></p><ul><li><p><strong><span>Neutrality is the goal: </span></strong><span>As the New York Times also found, frontier labs creating these chatbots are striving for neutrality &#8211; in our data so far, we have found that models are clearly orienting around this goal. Models present generally positive views on bio and issues, unless asked specifically about criticisms of a candidate.</span></p></li><li><p><strong><span>Sourcing: </span></strong><span>Our core finding is that the sources chatbots draw on vary widely from model to model, and even within model runs. </span><a href="/__u/caucusai.substack.com/p/same-answers-different-sources"><span>Models appear to heavily favor certain publishers</span></a><span>&#8211;many of which have </span><a href="https://www.tryprofound.com/resources/articles/ai-model-publisher-partners"><span>content partnerships</span></a><span> with the labs&#8211;and can ignore otherwise prominent outlets and sites. This means that when a user selects a model, they are unknowingly selecting into a specific information ecosystem.</span></p></li><li><p><strong><span>Answers update quickly: </span></strong><span>Because most frontier AI chatbots use web search to respond to questions about elections, it means they have the ability to incorporate new content as soon as it goes live online. This is helpful with breaking news &#8211; while monitoring California&#8217;s governor&#8217;s race, we found that chatbots picked up information about </span><a href="https://www.cnn.com/2026/04/10/us/eric-swalwell-sexual-misconduct-allegations-invs"><span>sexual misconduct allegations</span></a><span> against Eric Swalwell the same day news stories broke. On the other hand, less well-vetted user-generated content may also be picked up quickly &#8211; </span><a href="https://www.fwiw.news/cp/193088397"><span>in March</span></a><span>, we created two Wikipedia pages for candidates we thought met Wikipedia&#8217;s notability regulations, but didn&#8217;t yet have pages. This content was picked up by ChatGPT in under 15 minutes.</span></p></li><li><p><strong><span>Incumbency and prominence matter:</span></strong><span> As Yamil Velez pointed out in the article, chatbots favor candidates with bigger media footprints. </span><a href="/__u/caucusai.substack.com/p/same-answers-different-sources"><span>We quantified this</span></a><span> with a similarity exercise: comparing chatbot responses to candidate websites (using the website as a proxy for the message the candidate is trying to deliver to voters). We found that chatbot responses were more similar to candidates&#8217; websites for incumbents and more prominent candidates. Challengers and less prominent candidates have a harder time getting their message across via chatbot.</span></p></li></ul><h3><strong><span>What we still don&#8217;t know</span></strong></h3><p><span>All of this is dynamic &#8211; frontier AI labs are developing policy and partnerships in real time, chatbots increasingly rely on </span><em><span>memory </span></em><span>of users&#8217; preferences, chatbot use and voter attitudes toward AI in general are rapidly changing, and campaigns themselves are exploring ways to adapt to an increasingly AI-generated information ecosystem.</span></p><p><span>We will be expanding our work with Caucus AI to explore these open questions and monitor change over time as November approaches. If you have ideas for what we should look into next or want to dig into what chatbots are saying about a specific race, please get in touch!</span></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://caucusai.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading! Subscribe for free to receive new posts.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[What Will Voters Ask AI About the 2026 Election?]]></title><description><![CDATA[We asked voters to tell us what they'd query chatbots to learn about 2026 candidates.]]></description><link>https://caucusai.substack.com/p/what-will-voters-ask-ai-about-the</link><guid isPermaLink="false">https://caucusai.substack.com/p/what-will-voters-ask-ai-about-the</guid><dc:creator><![CDATA[Caucus AI]]></dc:creator><pubDate>Mon, 01 Jun 2026 11:04:18 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!ZHnB!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcf1c940c-bdd9-4ec2-92b4-33a1f645de1d_1220x726.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><a href="/__u/caucusai.substack.com/p/whos-asking-ai-about-the-2026-election">In last week&#8217;s post</a>, we reviewed polling data from <a href="https://changeresearch.com/">Change Research</a> that found that a small but potentially decisive share (15%) of voters plan to use AI chatbots to learn about political candidates this year. These voters skew young, non-white, and male. <strong>This week, we&#8217;re digging into what voters will actually ask AI chatbots.</strong></p><p>The findings below reflect Change Research&#8217;s survey of 1,892 respondents weighted to a registered voter population. The survey was fielded from May 5-10, 2026. Respondents were recruited using a combination of targeted digital ads and text-to-web SMS, and all respondents took the survey online.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://caucusai.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="/__u/caucusai.substack.com/subscribe"><span>Subscribe now</span></a></p><h3>What they&#8217;ll ask</h3><p>When voters do<em> </em>go to a chatbot for political information, what do they actually ask it? This information is critical for <a href="https://caucus-ai.com/">Caucus AI</a>, because the response information we are gathering is only helpful if our prompts reflect what real voters actually ask. We collected actual questions respondents said they would pose to a chatbot to learn about candidates for office in 2026.</p><div id="datawrapper-iframe" class="datawrapper-wrap outer" data-attrs="{&quot;url&quot;:&quot;https://datawrapper.dwcdn.net/kGckt/1/&quot;,&quot;thumbnail_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/cf1c940c-bdd9-4ec2-92b4-33a1f645de1d_1220x726.png&quot;,&quot;thumbnail_url_full&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/8857af10-3641-449d-8ed7-41bdd4c069fa_1220x938.png&quot;,&quot;height&quot;:462,&quot;title&quot;:&quot;What Americans say they would ask an AI chatbot when trying to learn information about political candidates&quot;,&quot;description&quot;:&quot;Open-ended responses categorized as one of 7 topics by Gemini 3 Flash&quot;,&quot;belowTheFold&quot;:false}" data-component-name="DatawrapperToDOM"><iframe id="iframe-datawrapper" class="datawrapper-iframe" src="https://datawrapper.dwcdn.net/kGckt/1/" width="730" height="462" frameborder="0" scrolling="no"></iframe><script type="text/javascript">!function(){"use strict";window.addEventListener("message",(function(e){if(void 0!==e.data["datawrapper-height"]){var t=document.querySelectorAll("iframe");for(var a in e.data["datawrapper-height"])for(var r=0;r<t.length;r++){if(t[r].contentWindow===e.source)t[r].style.height=e.data["datawrapper-height"][a]+"px"}}}))}();</script></div><p>Of substantive responses (see below for refusals!), nearly half (49%) were asking about candidate records and issue positions. 18% were requests for the chatbot to compare and contrast candidates or recommend who to vote for. Questions about who is running and candidate biography were 9% and 8% of requests respectively. All of this information is covered by existing prompts in the Caucus AI tool &#8211; although we do not (yet) ask chatbots directly to compare and contrast candidates &#8211; we prompt for issues, bio, and criticisms of specific candidates, and chatbots often return comparative responses.</p><p>Interestingly, 9% of questions were requests for information on candidates representing particular ideologies or parties (or who had been endorsed by specific people, mostly Donald Trump). This partisan information-seeking is interesting, because it prompts the chatbot directly to focus on particular types of candidates rather than returning the full picture. <a href="https://arxiv.org/abs/2511.04706">Other</a> <a href="https://arxiv.org/abs/2604.27633">research</a> has indicated that chatbots respond differently to users when prompted to think they are Democrats or Republicans, so this is an area to dig into further in future work.</p><h4>Is AI just regular-old search?</h4><p>Do chatbot users use AI search any differently than they already use search engines? While we don&#8217;t have a comparison dataset of old-fashioned search queries, we are able to get a sense of what share of queries to chatbots require <em>synthesis</em> to answer versus the share that could be answered by clicking on a single result from a search engine. We define synthesis questions as queries that require the AI chatbot to summarize or compare across multiple sources, candidates, or questions or to subjectively reason about a question. Example synthesis queries in our dataset include &#8220;Which candidate is more likely to tell the truth and practice what they preach?&#8221; and &#8220;Who takes corporate money? Who takes aipac money? Who supports Palestine?&#8221; More straightforward search queries include &#8220;How does candidate stand on the issue of lowering taxes&#8221; and &#8220;Who is the Republican?&#8221; These questions can be answered by chatbot synthesis, but are straightforward to answer via regular search engine results as well.</p><div id="datawrapper-iframe" class="datawrapper-wrap outer" data-attrs="{&quot;url&quot;:&quot;https://datawrapper.dwcdn.net/8au6y/1/&quot;,&quot;thumbnail_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/342087b8-25cc-428b-84e6-94cd486ac738_1220x420.png&quot;,&quot;thumbnail_url_full&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/6e14811f-5862-4347-a284-0efc8a812241_1220x666.png&quot;,&quot;height&quot;:324,&quot;title&quot;:&quot;Younger voters most likely to use AI &#8212; and to ask for synthesis when they do&quot;,&quot;description&quot;:&quot;Open-ended responses to what voters would ask an AI chatbot to learn about candidates, categorized by Gemini 3 Flash&quot;,&quot;belowTheFold&quot;:true}" data-component-name="DatawrapperToDOM"><iframe id="iframe-datawrapper" class="datawrapper-iframe" src="https://datawrapper.dwcdn.net/8au6y/1/" width="730" height="324" frameborder="0" scrolling="no" loading="lazy"></iframe><script type="text/javascript">!function(){"use strict";window.addEventListener("message",(function(e){if(void 0!==e.data["datawrapper-height"]){var t=document.querySelectorAll("iframe");for(var a in e.data["datawrapper-height"])for(var r=0;r<t.length;r++){if(t[r].contentWindow===e.source)t[r].style.height=e.data["datawrapper-height"][a]+"px"}}}))}();</script></div><p>Overall, 39% of respondents provided a synthesis prompt compared to 16% who asked a more standard search question (45% of all respondents refused to provide a prompt). Younger voters are much more likely to ask synthesis questions (56%) compared to voters over age 65 (32%). Part of this is driven by younger voters&#8217; lower refusal rates &#8211; older respondents were much more likely to refuse to provide a prompt (48% compared to 33% for voters under 35) &#8211; but some of the difference is also driven by older voters being more likely to ask search-type questions.</p><h4>AI Backlash</h4><p>Refusals in the survey also paint an interesting picture of how Americans are feeling about AI in politics. Almost half (45%) of respondents refused to provide an example of what they would ask a chatbot to learn about candidates. Of respondents who refused, just over half specifically said they would not use AI to learn about politics, while 28% were generic &#8220;NA&#8221; answers and 20% were off-topic responses. Many responses expressed real hostility toward AI (such as &#8220;Fuck AI&#8221;, which four respondents wrote verbatim), reflecting what we see throughout the survey and in other research: many Americans do not like AI and do not want to use it at all. Polling from Searchlight Institute in late 2025 found Americans had <a href="https://www.searchlightinstitute.org/research/americans-have-mixed-views-of-ai-and-an-appetite-for-regulation/">mixed views</a> on the impact of AI overall, support regulation, and view AI significantly less favorably than other technology. A <a href="https://www.nbcnews.com/politics/politics-news/poll-majority-voters-say-risks-ai-outweigh-benefits-rcna262196">March NBC News poll</a> found that 57% of registered voters think the risks of AI outweigh the benefits, compared to 34% who said the benefits outweighed the risks. 71% of Americans in a May 2026 <a href="https://yougov.com/en-us/articles/54762-most-americans-say-artificial-intelligence-ai-development-moving-too-fast-twice-as-many-ai-pessimists-as-ai-optimists-may-9-11-2026-economist-yougov-poll">YouGov / Economist poll</a> said that AI is moving too fast. Nowhere has public opinion soured more related to AI than on support for building data centers, which dropped from 65% in March 2025 to 36% in April 2026, according to <a href="https://changeresearch.com/opposition-to-data-centers-has-grown-sharply-since-2025/">Change Research polling</a>.</p><p>Most respondents who said they wouldn&#8217;t use AI did not give a specific reason (72%). Of those who did, about half cited that they did not trust the accuracy of chatbot information for politics or thought it would be biased, 22% expressed general hostility / dislike toward AI, and a handful expressed concern over societal or environmental harms of AI or said they generally prefer to rely on themselves, not chatbots, to learn about politics.</p><h4>Implications for the Caucus AI tool and future work</h4><p>This deeper dive into what people will actually ask chatbots about politics tells us two things. First, Caucus AI largely covers the most common candidate- and district-specific questions: who is running, candidate bio, issue positions, and criticisms. What Caucus AI fails to capture right now is the widespread <em>comparative</em> nature of many user queries &#8211; voters will be asking chatbots directly who they should vote for, who is better on specific issues that they care about, and who has been endorsed by various parties and organizations. We also do not capture the variety of ways questions can be asked and how the wording of prompts may impact chatbot responses. These are gaps that we will work to address in future releases for the Caucus AI tool.</p><p>Second, we see a clear divide emerging in the electorate on the use of AI chatbots to learn about politics. We laid out in our <a href="/__u/caucusai.substack.com/p/whos-asking-ai-about-the-2026-election">last post</a> that a small minority of voters (15%) plan to use AI this fall to learn about candidates, and these voters are also the ones most likely to ask demanding synthesis questions of chatbots &#8211; relying on them to summarize over multiple sources or make judgment calls at higher rates than older voters. On the other hand, close to half of respondents refused to offer a question they might ask a chatbot and many expressed real hostility toward AI, which mirrors the general anxiety and decline in favorability of AI that we see across public opinion polling.</p><p>This work represents a foundation to build off of, as Americans continue to adapt, adopt, or reject AI and as AI capabilities continue to develop.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://caucusai.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading! Subscribe for free to receive new posts.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[Who's Asking AI About the 2026 Election?]]></title><description><![CDATA[How many voters will actually turn to AI for political information this Fall?]]></description><link>https://caucusai.substack.com/p/whos-asking-ai-about-the-2026-election</link><guid isPermaLink="false">https://caucusai.substack.com/p/whos-asking-ai-about-the-2026-election</guid><dc:creator><![CDATA[Caucus AI]]></dc:creator><pubDate>Thu, 21 May 2026 11:46:00 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/813b2beb-3840-44e2-9d54-526dbd5ac680_1218x600.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>How many voters will actually turn to AI for political information this fall? And how do chatbots stack up against other sources of political information voters might turn to? To explore this, we collaborated with <a href="https://changeresearch.com/">Change Research</a> to ask two questions on a national poll of registered voters. We found that a small but potentially decisive share (15%) of voters plan to seek political information from AI chatbots&#8211;with young voters and voters of color the most likely to do so&#8211;and a much larger swath of the electorate is likely to encounter AI election information via Google Search and AI search overviews.</p><p>The findings below reflect Change Research&#8217;s survey of 1,892 respondents weighted to a registered voter population. The survey was fielded from May 5-10, 2026. Respondents were recruited using a combination of targeted digital ads and text-to-web SMS, and all respondents took the survey online.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://caucusai.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption"></p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p><h3>AI as a source of political information</h3><p>Asked which information sources they were likely to use to learn about candidates running for office in 2026, most Americans say they will rely on news articles (68% very or somewhat likely to use), discussions with friends, family, or colleagues (62%), candidate websites (57%), and social media (53%).</p><p>A much smaller percentage say they plan to use an AI chatbot &#8211; just 15% of respondents said they were very or somewhat likely to use an AI chatbot to learn about candidates and a majority (58%) actually reported that they were <em>very unlikely </em>to do so. However, 62% said they would rely on Google Search to learn about candidates. Many of these searchers may be <a href="https://www.pewresearch.org/short-reads/2025/10/01/americans-have-mixed-feelings-about-ai-summaries-in-search-results/">exposed</a> to AI-generated political information via the AI summaries Google displays on top of search results, although it is unclear what share of political Google Search queries will have AI overviews.</p><p>These results highlight two key points: 1) although only a small slice of the electorate will actively seek out AI-generated information about this year&#8217;s elections, even a small segment of active AI information-seekers is large enough to be decisive in close elections and 2) a huge proportion of the electorate may encounter AI-generated political information through passive consumption.</p><div id="datawrapper-iframe" class="datawrapper-wrap outer" data-attrs="{&quot;url&quot;:&quot;https://datawrapper.dwcdn.net/VElz7/1/&quot;,&quot;thumbnail_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a9b4e020-c6f0-4c51-bb56-86f3346624f9_1220x586.png&quot;,&quot;thumbnail_url_full&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/ca14eb24-4464-4ab5-b24e-821d351d8629_1220x748.png&quot;,&quot;height&quot;:359,&quot;title&quot;:&quot;Where Americans plan to get political info in 2026&quot;,&quot;description&quot;:&quot;% reporting they are very or somewhat likely to consult each source&quot;,&quot;belowTheFold&quot;:false}" data-component-name="DatawrapperToDOM"><iframe id="iframe-datawrapper" class="datawrapper-iframe" src="https://datawrapper.dwcdn.net/VElz7/1/" width="730" height="359" frameborder="0" scrolling="no"></iframe><script type="text/javascript">!function(){"use strict";window.addEventListener("message",(function(e){if(void 0!==e.data["datawrapper-height"]){var t=document.querySelectorAll("iframe");for(var a in e.data["datawrapper-height"])for(var r=0;r<t.length;r++){if(t[r].contentWindow===e.source)t[r].style.height=e.data["datawrapper-height"][a]+"px"}}}))}();</script></div><h4>Who is most likely to turn to a chatbot?</h4><p>Voters under age 35 are nearly three times more likely to say they will actively seek information from AI chatbots (21%) than voters over age 65 (8%). This is still far lower than the share of voters under 35 who say they will rely on social media (69%), but means that one fifth of young voters plan to rely on chatbots as an information source as they make voting decisions in November.</p><p>Voters of color are much more likely to say they will use chatbots for political information compared to white respondents (21% vs. 12%) and men are slightly more likely than women to do so (17% vs. 13%).</p><p>Broken out by partisanship, there are modest partisan differences on intent to use AI, but larger differences among those who say they are very <em>unlikely </em>to use AI &#8211; 60% of Democrats, 54% of Republicans, and 68% of Independents say they are very unlikely to use AI to learn about candidates this year.</p><p>Respondents who were undecided on the generic Congressional ballot were less likely to say they would use a chatbot (9% very or somewhat likely) than those voting for Democrats (15%) or Republicans (17%). These undecided respondents tend to be a hard-to-reach population and they were significantly less likely to say they would seek out information on <em>all</em> of the channels asked about above than voters already supporting Democrats and Republicans.</p><div id="datawrapper-iframe" class="datawrapper-wrap outer" data-attrs="{&quot;url&quot;:&quot;https://datawrapper.dwcdn.net/gx6oU/2/&quot;,&quot;thumbnail_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/55135f0c-8843-45a3-84ad-9f251738002b_1220x1210.png&quot;,&quot;thumbnail_url_full&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/73ad811c-833e-4886-891b-9a5be29efd2a_1220x1456.png&quot;,&quot;height&quot;:719,&quot;title&quot;:&quot;Young and non-white Americans are most likely to ask AI chatbots about politics&quot;,&quot;description&quot;:&quot;% saying they are very or somewhat likely to us an AI chatbot for information about candidates running for office.&quot;,&quot;belowTheFold&quot;:true}" data-component-name="DatawrapperToDOM"><iframe id="iframe-datawrapper" class="datawrapper-iframe" src="https://datawrapper.dwcdn.net/gx6oU/2/" width="730" height="719" frameborder="0" scrolling="no" loading="lazy"></iframe><script type="text/javascript">!function(){"use strict";window.addEventListener("message",(function(e){if(void 0!==e.data["datawrapper-height"]){var t=document.querySelectorAll("iframe");for(var a in e.data["datawrapper-height"])for(var r=0;r<t.length;r++){if(t[r].contentWindow===e.source)t[r].style.height=e.data["datawrapper-height"][a]+"px"}}}))}();</script></div><h3>How much do voters trust AI-generated information about politics?</h3><p>Next, we wanted to assess whether voters view AI-generated political information as more or less accurate than information from candidates themselves. We know that Americans are <a href="https://poll.qu.edu/poll-release?releaseid=3955">generally pessimistic</a> about the accuracy of AI and AI&#8217;s impact on society. Americans are also <a href="https://www.pewresearch.org/short-reads/2026/04/15/americans-stand-out-internationally-for-their-pessimism-about-the-nations-political-system/">pessimistic</a> about politics and have <a href="https://navigatorresearch.org/why-americans-dont-trust-their-elected-officials-and-how-to-fix-it/">low trust in elected officials</a>. Between candidate- and AI-provided information, which source wins out? Candidate information wins out as more trustworthy (36% to 14%).</p><p>When asked, <em>&#8220;When it comes to information about political candidates, which do you find more accurate, answers from AI tools (e.g., ChatGPT, AI search summaries) or information from the candidates themselves?&#8221;</em>, more than a third of respondents (36%) said that neither are accurate. 14% said that AI-generated information is somewhat or much more accurate, while 36% said candidate-generated information is more accurate. 14% said AI- and candidate-generated information are equally accurate.</p><p>By subgroup, trust mirrors likelihood to use AI, with 31% of respondents under 35 saying AI-generated information is equally accurate to or more accurate than candidate information. 37% of voters of color (including nearly half of Black voters) said that AI is equally or more accurate.</p><p>An outright majority of Independents (56%) responded that neither source was accurate.</p><div id="datawrapper-iframe" class="datawrapper-wrap outer" data-attrs="{&quot;url&quot;:&quot;https://datawrapper.dwcdn.net/YD9nI/2/&quot;,&quot;thumbnail_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/08e535c1-1646-43d4-a9bf-b581438200b4_1220x1246.png&quot;,&quot;thumbnail_url_full&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/18b893fe-3174-4a2b-b56c-8eb9ed0bd43a_1220x1492.png&quot;,&quot;height&quot;:737,&quot;title&quot;:&quot;Americans trust info from AI less than info from candidates, but many do not trust either source&quot;,&quot;description&quot;:&quot;% responses to&quot;,&quot;belowTheFold&quot;:true}" data-component-name="DatawrapperToDOM"><iframe id="iframe-datawrapper" class="datawrapper-iframe" src="https://datawrapper.dwcdn.net/YD9nI/2/" width="730" height="737" frameborder="0" scrolling="no" loading="lazy"></iframe><script type="text/javascript">!function(){"use strict";window.addEventListener("message",(function(e){if(void 0!==e.data["datawrapper-height"]){var t=document.querySelectorAll("iframe");for(var a in e.data["datawrapper-height"])for(var r=0;r<t.length;r++){if(t[r].contentWindow===e.source)t[r].style.height=e.data["datawrapper-height"][a]+"px"}}}))}();</script></div><h3>Implications for 2026 and beyond</h3><p>A significant minority of voters (15%) will actively seek out information from AI chatbots when they go to the polls this Fall. Even more may be exposed to AI-generated election information via search. These voters are disproportionately young and Black, Hispanic, and Asian &#8211; some of the <a href="https://catalist.us/whathappened2024/">exact demographics</a> that have been the among the most persuadable in recent elections. And while most voters distrust AI, the same groups using it are <em>more</em> likely to trust it than others. In close races, AI-generated information could be decisive.</p><p>AI is also here to stay. Americans increasingly use generative AI across their work and personal lives, with the <a href="https://www.stlouisfed.org/on-the-economy/2025/nov/state-generative-ai-adoption-2025">pace of adoption</a> tracking ahead of previous transformative technologies such as the personal computer and the internet. In 1996, just 4% of voters sought political information online &#8211; <a href="https://www.pewresearch.org/internet/2000/12/03/internet-election-news-audience-seeks-convenience-familiar-names/">rising to 18% in 2000</a> and <a href="https://www.pewresearch.org/internet/2005/03/06/the-internet-and-campaign-2004/">29% in 2004</a>. More than 20 years later, many Americans <a href="https://www.pewresearch.org/chart/daily-internet-use-is-the-norm-for-u-s-adults-and-about-4-in-10-say-theyre-almost-constantly-online/">live their lives online</a>. This fall, more than half of voters say they plan to seek out political information via Google Search and candidate websites (not to mention news articles that are largely online).</p><p>We are in the very early stages of observing what impact AI-generated information will have on American politics (and wider society). Understanding what chatbots tell voters is already critical and as the share of voters consulting AI sources grows, it will only become more important.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://caucusai.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading! Subscribe for free to receive new posts.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[What chatbots tell voters about candidates' positions and their critics]]></title><description><![CDATA[And what they're less likely to say]]></description><link>https://caucusai.substack.com/p/what-chatbots-tell-voters-about-candidates</link><guid isPermaLink="false">https://caucusai.substack.com/p/what-chatbots-tell-voters-about-candidates</guid><dc:creator><![CDATA[Caucus AI]]></dc:creator><pubDate>Tue, 12 May 2026 12:01:53 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/267f7887-9a0d-469e-bd9e-ccb853679123_1090x738.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>AI chatbots are increasingly how voters learn about candidates for office. Millions of Americans are turning to chatbots like ChatGPT to learn about politics, the same way they already turn to Google search. We built Caucus AI because we know very little about what chatbots say on political topics &#8211; we&#8217;re building a record of what these tools tell voters.</p><p><strong>Information on issues and criticisms are now live in <a href="https://caucus-ai.com/">Caucus AI</a>.</strong> We know what chatbots say about who is running and who candidates are &#8211; now we can also explore what chatbots say in response to user prompts &#8220;Where does [candidate] stand on important issues?&#8221; and &#8220;What are the main criticisms of [candidate]?&#8221; These additions were among the most-requested features from early users of Caucus AI &#8211; the post below digs into what we&#8217;ve found so far.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://caucusai.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="/__u/caucusai.substack.com/subscribe"><span>Subscribe now</span></a></p><h2><strong>The Setup</strong></h2><p>We ask three models (Gemini, GPT, and Grok) multiple questions about 2026 political candidates. We store every response, extract the sources each model cites, and compare and contrast answers across model providers. With each query, we allow the model to use web search tools, to better mimic how AI chatbots and AI-enhanced search behave for real users. We run each prompt twice, to capture some of the random variation in chatbot responses.</p><p>The analysis below focuses on Senate, Governor, and House races that are rated by Cook Political Report as competitive (toss-up, lean, or likely) &#8211; representing competitive races that have a variety of online coverage.</p><h2><strong>Wikipedia owns bio, campaigns own issues, and nobody owns criticisms</strong></h2><p>There is striking variation in what websites the chatbots cite. Our initial analyses focused on bio-style questions (&#8220;Tell me about Candidate X&#8221;) and <a href="/__u/caucusai.substack.com/p/the-source-gap-early-findings-on">we found</a> that the chatbots cited reference websites like Wikipedia, Encyclopedia Britannica, and Ballotpedia heavily. We can see that this does not hold for Issues and Criticisms responses.</p><div id="datawrapper-iframe" class="datawrapper-wrap outer" data-attrs="{&quot;url&quot;:&quot;https://datawrapper.dwcdn.net/Buex4/1/&quot;,&quot;thumbnail_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/8afb99ca-2bb5-49cd-81e5-1525f1e59004_1220x608.png&quot;,&quot;thumbnail_url_full&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/fc38a34d-3d75-4fa9-912c-0152f34398e4_1220x678.png&quot;,&quot;height&quot;:334,&quot;title&quot;:&quot;Citation sources by question topic&quot;,&quot;description&quot;:&quot;&quot;,&quot;belowTheFold&quot;:false}" data-component-name="DatawrapperToDOM"><iframe id="iframe-datawrapper" class="datawrapper-iframe" src="https://datawrapper.dwcdn.net/Buex4/1/" width="730" height="334" frameborder="0" scrolling="no"></iframe><script type="text/javascript">!function(){"use strict";window.addEventListener("message",(function(e){if(void 0!==e.data["datawrapper-height"]){var t=document.querySelectorAll("iframe");for(var a in e.data["datawrapper-height"])for(var r=0;r<t.length;r++){if(t[r].contentWindow===e.source)t[r].style.height=e.data["datawrapper-height"][a]+"px"}}}))}();</script></div><p>For Issues responses, the chatbots rely about equally on campaign websites, reference sites, and local news. Relative to other sources, candidates have the most say in shaping what chatbots tell users here, since they control their own campaign websites.</p><p>For criticisms, we see a <em>heavy </em>reliance on local news with about a third of references from local news and a further 17.3% from national news. Social media also rises in importance &#8211; this is driven by Grok, but is true for Gemini and GPT as well. Partisan sites are nearly twice as frequently cited for criticisms as for bio. Reference, campaign, and official websites &#8211; the anchors of biographical answers &#8211; represent just 12.5% of all Criticism citations.</p><p>Looking more closely at specific websites cited by models for criticisms, we can see the prominence of social media&#8212;YouTube dominates Gemini citations for criticisms of Democratic candidates, Reddit is prominent throughout&#8212;and of partisan sources, like the Democratic and Republican House campaign committee websites (DCCC and NRCC). GPT consistently and heavily relies on Wikipedia in a way the other models do not: Wikipedia is GPT&#8217;s single most-cited source for criticisms of both parties.</p><div id="datawrapper-iframe" class="datawrapper-wrap outer" data-attrs="{&quot;url&quot;:&quot;https://datawrapper.dwcdn.net/5EQsE/3/&quot;,&quot;thumbnail_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a928f761-ac3a-4cfe-9f6a-1942e9707649_1220x436.png&quot;,&quot;thumbnail_url_full&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/3ec51a8c-6cae-414a-aced-c90f2c3112ee_1220x560.png&quot;,&quot;height&quot;:271,&quot;title&quot;:&quot;Most-cited websites for candidate criticisms&quot;,&quot;description&quot;:&quot;Among Cook-competitive 2026 Governor, Senate, and House races&quot;,&quot;belowTheFold&quot;:true}" data-component-name="DatawrapperToDOM"><iframe id="iframe-datawrapper" class="datawrapper-iframe" src="https://datawrapper.dwcdn.net/5EQsE/3/" width="730" height="271" frameborder="0" scrolling="no" loading="lazy"></iframe><script type="text/javascript">!function(){"use strict";window.addEventListener("message",(function(e){if(void 0!==e.data["datawrapper-height"]){var t=document.querySelectorAll("iframe");for(var a in e.data["datawrapper-height"])for(var r=0;r<t.length;r++){if(t[r].contentWindow===e.source)t[r].style.height=e.data["datawrapper-height"][a]+"px"}}}))}();</script></div><h2><strong>On the issues</strong></h2><p>When evaluating model responses, we classified each response segment by topic (see the methodology section below for more). On average, each model covered about 4 topics per issue response. Issues topics break down fairly cleanly by the topics each party typically emphasizes, and the framing they tend to employ. Democrats&#8217; issue responses talk disproportionately about healthcare, the economy and jobs, and reproductive rights. Republicans&#8217; issue responses spend more time on taxes and budget issues, immigration and border security, and crime.</p><div id="datawrapper-iframe" class="datawrapper-wrap outer" data-attrs="{&quot;url&quot;:&quot;https://datawrapper.dwcdn.net/qmN63/2/&quot;,&quot;thumbnail_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/bacfd1a6-b90a-4c23-9971-e122692d17c0_1220x900.png&quot;,&quot;thumbnail_url_full&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/97674e0e-996d-49ca-856c-ee60fd331573_1220x1062.png&quot;,&quot;height&quot;:527,&quot;title&quot;:&quot;Issues topics by model and party&quot;,&quot;description&quot;:&quot;Among Cook-competitive 2026 Governor, Senate, and House races&quot;,&quot;belowTheFold&quot;:true}" data-component-name="DatawrapperToDOM"><iframe id="iframe-datawrapper" class="datawrapper-iframe" src="https://datawrapper.dwcdn.net/qmN63/2/" width="730" height="527" frameborder="0" scrolling="no" loading="lazy"></iframe><script type="text/javascript">!function(){"use strict";window.addEventListener("message",(function(e){if(void 0!==e.data["datawrapper-height"]){var t=document.querySelectorAll("iframe");for(var a in e.data["datawrapper-height"])for(var r=0;r<t.length;r++){if(t[r].contentWindow===e.source)t[r].style.height=e.data["datawrapper-height"][a]+"px"}}}))}();</script></div><p>When we look at the economy and costs, <em>the </em>core issue in 2026, we can see that responses for both parties lean into that party&#8217;s framing. Model responses for Democrats emphasize tariffs, taxes, jobs and workers, while Republican responses emphasize cutting spending and taxes. Costs, wages, housing all pop for Democrats, while inflation, small businesses, and &#8220;cuts&#8221; are more prominent for Republicans.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!bqUc!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F72d81081-b44f-4f85-99d2-1315aae75a9b_2485x1399.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!bqUc!, /__u/caucusai.substack.com/w_424, /__u/caucusai.substack.com/c_limit, /__u/caucusai.substack.com/f_webp, /__u/caucusai.substack.com/q_auto:good, /__u/caucusai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F72d81081-b44f-4f85-99d2-1315aae75a9b_2485x1399.png 424w, /__u/substackcdn.com/image/fetch/$s_!bqUc!, /__u/caucusai.substack.com/w_848, /__u/caucusai.substack.com/c_limit, /__u/caucusai.substack.com/f_webp, /__u/caucusai.substack.com/q_auto:good, /__u/caucusai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F72d81081-b44f-4f85-99d2-1315aae75a9b_2485x1399.png 848w, /__u/substackcdn.com/image/fetch/$s_!bqUc!, /__u/caucusai.substack.com/w_1272, /__u/caucusai.substack.com/c_limit, /__u/caucusai.substack.com/f_webp, /__u/caucusai.substack.com/q_auto:good, /__u/caucusai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F72d81081-b44f-4f85-99d2-1315aae75a9b_2485x1399.png 1272w, /__u/substackcdn.com/image/fetch/$s_!bqUc!, /__u/caucusai.substack.com/w_1456, /__u/caucusai.substack.com/c_limit, /__u/caucusai.substack.com/f_webp, /__u/caucusai.substack.com/q_auto:good, /__u/caucusai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F72d81081-b44f-4f85-99d2-1315aae75a9b_2485x1399.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!bqUc!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F72d81081-b44f-4f85-99d2-1315aae75a9b_2485x1399.png" width="1456" height="820" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/72d81081-b44f-4f85-99d2-1315aae75a9b_2485x1399.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:820,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1576052,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://caucusai.substack.com/i/196856723?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F72d81081-b44f-4f85-99d2-1315aae75a9b_2485x1399.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!bqUc!, /__u/caucusai.substack.com/w_424, /__u/caucusai.substack.com/c_limit, /__u/caucusai.substack.com/f_auto, /__u/caucusai.substack.com/q_auto:good, /__u/caucusai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F72d81081-b44f-4f85-99d2-1315aae75a9b_2485x1399.png 424w, /__u/substackcdn.com/image/fetch/$s_!bqUc!, /__u/caucusai.substack.com/w_848, /__u/caucusai.substack.com/c_limit, /__u/caucusai.substack.com/f_auto, /__u/caucusai.substack.com/q_auto:good, /__u/caucusai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F72d81081-b44f-4f85-99d2-1315aae75a9b_2485x1399.png 848w, /__u/substackcdn.com/image/fetch/$s_!bqUc!, /__u/caucusai.substack.com/w_1272, /__u/caucusai.substack.com/c_limit, /__u/caucusai.substack.com/f_auto, /__u/caucusai.substack.com/q_auto:good, /__u/caucusai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F72d81081-b44f-4f85-99d2-1315aae75a9b_2485x1399.png 1272w, /__u/substackcdn.com/image/fetch/$s_!bqUc!, /__u/caucusai.substack.com/w_1456, /__u/caucusai.substack.com/c_limit, /__u/caucusai.substack.com/f_auto, /__u/caucusai.substack.com/q_auto:good, /__u/caucusai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F72d81081-b44f-4f85-99d2-1315aae75a9b_2485x1399.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2><strong>Criticisms</strong></h2><p>When it comes to criticisms, Gemini and GPT are most likely to cite policy positions as the main area of critique, while Grok prefers scandals (ethics, corruption, and personal scandal topics). Across all three models, Republicans are more likely to be criticized for their policy positions, reflecting the 2026 climate and the GOP&#8217;s disproportionate incumbent status.</p><p>GPT is more likely than the other models to frame Democrats as ideologically extreme &#8211; both for being too far left, as well as for being too moderate. In other words, GPT picks up on criticisms of centrist Democrats from the left.</p><p>All models highlight Republican candidates&#8217; histories of election denial, and Democrats are two to three times more likely to have some criticism for being out of touch with voters.</p><div id="datawrapper-iframe" class="datawrapper-wrap outer" data-attrs="{&quot;url&quot;:&quot;https://datawrapper.dwcdn.net/uPvVV/1/&quot;,&quot;thumbnail_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a6fc02f3-1449-42a0-83c8-d46fd015d9c8_1220x1094.png&quot;,&quot;thumbnail_url_full&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d1532a8f-423d-48df-8e23-9a245e82d6ef_1220x1218.png&quot;,&quot;height&quot;:625,&quot;title&quot;:&quot;Criticisms topics by model and party&quot;,&quot;description&quot;:&quot;Among Cook-competitive 2026 Governor, Senate, and House races&quot;,&quot;belowTheFold&quot;:true}" data-component-name="DatawrapperToDOM"><iframe id="iframe-datawrapper" class="datawrapper-iframe" src="https://datawrapper.dwcdn.net/uPvVV/1/" width="730" height="625" frameborder="0" scrolling="no" loading="lazy"></iframe><script type="text/javascript">!function(){"use strict";window.addEventListener("message",(function(e){if(void 0!==e.data["datawrapper-height"]){var t=document.querySelectorAll("iframe");for(var a in e.data["datawrapper-height"])for(var r=0;r<t.length;r++){if(t[r].contentWindow===e.source)t[r].style.height=e.data["datawrapper-height"][a]+"px"}}}))}();</script></div><h2><strong>I&#8217;m sorry, Dave. I&#8217;m afraid I can&#8217;t do that</strong></h2><p>We found that for 21% of criticisms responses, GPT did not return a substantive answer. Most frequently, the non-substantive answer was a request for clarification or saying it did not know any person by that name. GPT had by far the highest rate of non-substantive answering, Gemini was at 2% and Grok at 4%. Non-substantive responses for all models appear disproportionately for House challengers &#8211; candidates with smaller digital footprints than higher-profile races or established incumbents.</p><p>Interestingly, 41% of the queries that had no GPT response to a request for criticisms, <em>did</em> have a substantive response for the candidate bio prompt. In other words, when asked &#8220;Tell me about [candidate]&#8221;, GPT was comfortable proceeding, but with &#8220;what are the main criticisms of [candidate]?&#8221;, the model was much more likely to ask for clarification or say it did not know of the candidate.</p><h2><strong>The big picture</strong></h2><p>Three things stand out so far from these new Issues and Criticisms additions.</p><p>The sources chatbots draw on shift substantially based on what the user asks: encyclopedia-style reference sites dominate bio responses, while criticisms answers lean on social media, local news, and partisan sources.</p><p>Issues largely map onto familiar partisan territory: Responses for Democrats focus on healthcare, jobs, and the economy, while Republican responses focus on taxes, government spending, and immigration.</p><p>Consequentially for the user, GPT declines to answer &#8220;what are the main criticisms of [candidate]?&#8221; about one in five times. This behavior can determine whether a voter using GPT gets a critique of a candidate at all.</p><p>As we work to expand the tool, we&#8217;ll keep tracking how these patterns evolve through the cycle and what might be causing them. Issues and criticisms data is now live in Caucus AI &#8211; explore it for any candidate in a race we cover <a href="https://caucus-ai.com/">here</a>.</p><h2><strong>Methodology</strong></h2><ul><li><p><strong>Prompts:</strong> For each candidate we asked &#8220;Where does [candidate] stand on important issues?&#8221; and &#8220;What are the main criticisms of [candidate]?&#8221; Each model ran with web search enabled and ran each prompt twice to capture some of the randomness in chatbot answers.</p></li><li><p><strong>Classifying topics:</strong> we developed a fixed taxonomy of 19 topics for Issues responses and 17 for criticisms, developed based on a random sample of responses and human oversight. We use an LLM (Gemini Flash) as a classifier. The classifying model sees the full response and returns the topic of each sentence in the response. The unit of classification is the sentence, and response-level topics are aggregated from these sentences. The classifier does not know which model produced the response it is categorizing.</p></li><li><p><strong>Share of voice:</strong> Model responses usually include multiple topics and are not just about one issue or criticism. For example, a Democratic candidate&#8217;s issues answer might cover lowering costs, healthcare, climate, etc. all in one response. When we report how much a response was &#8220;about&#8221; a given topic, we use length and position weights. Topics that take up more of the total chatbot answer count for more, and <em>where </em>a topic is discussed matters too &#8211; topics discussed earlier in an answer count for more than later topics, since human readers tend to skim AI responses. Using the single most dominant topic or varying how we calculate salience produces largely similar findings to those presented above.</p></li></ul><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://caucusai.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading! Subscribe for free to receive new posts.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[Same answers, different sources]]></title><description><![CDATA[AI chatbots agree on what to say about candidates &#8212; but not where they got it.]]></description><link>https://caucusai.substack.com/p/same-answers-different-sources</link><guid isPermaLink="false">https://caucusai.substack.com/p/same-answers-different-sources</guid><dc:creator><![CDATA[Caucus AI]]></dc:creator><pubDate>Thu, 19 Mar 2026 12:01:37 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!_CvW!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F27fc63d3-f999-4690-8208-41a6ac820f5f_1950x2100.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>In a <a href="/__u/caucusai.substack.com/p/caucus-ai-what-generative-ai-tells">previous post</a>, we shared how generative AI is becoming a key source of political information and that when chatbots try to persuade, they&#8217;re effective.</p><p>In our latest analysis using <a href="https://caucus-ai.com/">Caucus AI</a>, we ask: <strong>How stable are standard AI chatbot responses to questions about political candidates and elections? Do citations actually influence response content?</strong></p><p>Users of generative AI tools know that you rarely get the exact same response to a question if you ask it multiple times. This is largely due to two factors:</p><ol><li><p><a href="https://www.ibm.com/think/topics/llm-temperature">Temperature</a>, or purposeful randomness setting (some newer models have a setting called  &#8220;effort&#8221; instead, which governs randomness slightly differently), in the model itself that helps models produce more &#8220;novel&#8221; outputs.</p></li><li><p><a href="https://mbrenndoerfer.com/writing/why-llms-are-not-deterministic">Implementation particulars</a> of large AI models that create variation in responses even when the temperature is set to be non-random.</p></li></ol><h2>Setup</h2><h4>Response variation</h4><p>We took a sample of prompts for different geographies and candidates and ran each prompt 15 times per model at the model&#8217;s default temperature/effort level. This allowed us to understand variation in responses.</p><p>We measured similarity of responses across 3 metrics:</p><ul><li><p><strong>Semantic similarity:</strong> Does a model say the same thing each time?</p></li><li><p><strong>Keyword overlap:</strong> Do models use the same words each time?</p></li><li><p><strong>Citation overlap and churn:</strong> Do responses cite the same source websites?</p></li></ul><h4>Citation-content correlation</h4><p>We scraped 994 candidates&#8217; campaign and official (.gov) websites. We compared the semantic similarity of chatbot responses to candidates&#8217; webpages on the following dimensions:</p><ul><li><p>Whether the candidate&#8217;s campaign and/or official webpage was cited by the chatbot</p></li><li><p>Candidate features: incumbency, partisanship, office level (House, Senate, Governor), and competitiveness</p></li><li><p>Site features: site type (campaign, official), page type (bio, issues, news, etc.)</p></li></ul><h2>Findings</h2><h4>Response content is quite stable.</h4><p>Overall, models return largely the same <em>meaning </em>even if they use different wording, structure, or formatting.</p><p>The <a href="https://www.ibm.com/think/topics/cosine-similarity">cosine similarity</a> of model responses to identical prompts is<strong> .94&#8211;.95 on average </strong>(out of a maximum of 1) across all three models, while metrics of overlap of specific vocabulary are lower.</p><p>Responses to more open-ended questions (&#8220;What does Jon Ossoff think about important issues in Georgia?&#8221;) had more variation than more fact-based questions (&#8220;Who is running for Senate in Georgia?&#8221;), as did responses to questions about lower-profile candidates and races.</p><h4>Citations vary widely</h4><p>The complete list of citations varies significantly from run to run, much more than the information conveyed in the responses.</p><p>We identified that each prompt-model combination had, on average:</p><ul><li><p><strong>2.4 core sources</strong> that were cited by more than 10 of the 15 responses</p></li><li><p><strong>3.8 frequent sources</strong> cited 4&#8211;10 times</p></li><li><p><strong>12.9 rare citations</strong> cited less than 4 times across all runs</p></li></ul><h4>Citations matter</h4><p><strong>Models are drawing from candidate websites.</strong> Average cosine similarity between chatbot responses and candidates&#8217; own site content is 0.67, with a median of 0.71. Two-thirds of the closest content matches are biographical pages (career history, background, personal details) rather than policy or issues pages (just 2.2% of best matches). This will likely change as we expand out the set of questions we&#8217;re asking the chatbots &#8211; right now, our questions focus on candidate backgrounds and biography</p><p><strong>Citing a site predicts meaningfully higher similarity.</strong> When a response explicitly cites a candidate&#8217;s website, it is significantly more similar to that site&#8217;s content than when it doesn&#8217;t. The effect is large: +12pp for campaign sites and +27pp for official (.gov) sites. This holds across all three models. GPT cites candidate sites least often (35% of responses) but shows the strongest content alignment when it does; Grok cites most often (68%) but with a smaller similarity gap, suggesting it references sites more liberally.</p><p><strong>Incumbents score much higher than challengers (0.703 vs 0.629)</strong>, the largest effect we observed. Incumbents have more web presence, more media coverage, and longer-standing official sites, all of which feed into training data. Challengers, especially lesser-known ones, have responses that diverge more significantly from their own website content.</p><h4>Example: Josh Shapiro</h4><p>As an example, we can look at the full set of citations for Pennsylvania Governor Josh Shapiro in response to the prompt &#8220;Tell me about Josh Shapiro.&#8221;</p><p>The chart below shows websites cited by each model. Several patterns emerge:</p><ul><li><p>All models cite Wikipedia frequently. It appears in every response from GPT 5.2 and Grok 4.1.</p></li><li><p>Gemini and Grok cite PA&#8217;s NPR affiliate, WHYY, while GPT 5.2 does not.</p></li><li><p>GPT 5.2 always cites a source from Axios, perhaps driven by OpenAI&#8217;s <a href="https://openai.com/index/partnering-with-axios-expands-openai-work-with-the-news-industry/">partnership</a> with Axios. The model also cites partner outlets such as <a href="https://apnews.com/article/openai-chatgpt-associated-press-ap-f86f84c5bcc2f3b98074b38521f5f75a">the AP</a> and <a href="https://openai.com/index/openai-and-guardian-media-group-launch-content-partnership/">The Guardian</a>.</p></li><li><p><a href="http://pa.gov">pa.gov</a> is cited frequently, but Shapiro&#8217;s 2026 campaign website (<a href="https://joshshapiro.org/">https://joshshapiro.org/</a>) is not cited at all.</p></li></ul><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="/__u/substackcdn.com/image/fetch/$s_!_CvW!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F27fc63d3-f999-4690-8208-41a6ac820f5f_1950x2100.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="/__u/substackcdn.com/image/fetch/$s_!_CvW!, /__u/caucusai.substack.com/w_424, /__u/caucusai.substack.com/c_limit, /__u/caucusai.substack.com/f_webp, /__u/caucusai.substack.com/q_auto:good, /__u/caucusai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F27fc63d3-f999-4690-8208-41a6ac820f5f_1950x2100.png 424w, /__u/substackcdn.com/image/fetch/$s_!_CvW!, /__u/caucusai.substack.com/w_848, /__u/caucusai.substack.com/c_limit, /__u/caucusai.substack.com/f_webp, /__u/caucusai.substack.com/q_auto:good, /__u/caucusai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F27fc63d3-f999-4690-8208-41a6ac820f5f_1950x2100.png 848w, /__u/substackcdn.com/image/fetch/$s_!_CvW!, /__u/caucusai.substack.com/w_1272, /__u/caucusai.substack.com/c_limit, /__u/caucusai.substack.com/f_webp, /__u/caucusai.substack.com/q_auto:good, /__u/caucusai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F27fc63d3-f999-4690-8208-41a6ac820f5f_1950x2100.png 1272w, /__u/substackcdn.com/image/fetch/$s_!_CvW!, /__u/caucusai.substack.com/w_1456, /__u/caucusai.substack.com/c_limit, /__u/caucusai.substack.com/f_webp, /__u/caucusai.substack.com/q_auto:good, /__u/caucusai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F27fc63d3-f999-4690-8208-41a6ac820f5f_1950x2100.png 1456w" sizes="100vw"><img src="/__u/substackcdn.com/image/fetch/$s_!_CvW!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F27fc63d3-f999-4690-8208-41a6ac820f5f_1950x2100.png" width="1456" height="1568" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/27fc63d3-f999-4690-8208-41a6ac820f5f_1950x2100.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1568,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:331187,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://caucusai.substack.com/i/191291117?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F27fc63d3-f999-4690-8208-41a6ac820f5f_1950x2100.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="/__u/substackcdn.com/image/fetch/$s_!_CvW!, /__u/caucusai.substack.com/w_424, /__u/caucusai.substack.com/c_limit, /__u/caucusai.substack.com/f_auto, /__u/caucusai.substack.com/q_auto:good, /__u/caucusai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F27fc63d3-f999-4690-8208-41a6ac820f5f_1950x2100.png 424w, /__u/substackcdn.com/image/fetch/$s_!_CvW!, /__u/caucusai.substack.com/w_848, /__u/caucusai.substack.com/c_limit, /__u/caucusai.substack.com/f_auto, /__u/caucusai.substack.com/q_auto:good, /__u/caucusai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F27fc63d3-f999-4690-8208-41a6ac820f5f_1950x2100.png 848w, /__u/substackcdn.com/image/fetch/$s_!_CvW!, /__u/caucusai.substack.com/w_1272, /__u/caucusai.substack.com/c_limit, /__u/caucusai.substack.com/f_auto, /__u/caucusai.substack.com/q_auto:good, /__u/caucusai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F27fc63d3-f999-4690-8208-41a6ac820f5f_1950x2100.png 1272w, /__u/substackcdn.com/image/fetch/$s_!_CvW!, /__u/caucusai.substack.com/w_1456, /__u/caucusai.substack.com/c_limit, /__u/caucusai.substack.com/f_auto, /__u/caucusai.substack.com/q_auto:good, /__u/caucusai.substack.com/fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F27fc63d3-f999-4690-8208-41a6ac820f5f_1950x2100.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>What does this mean?</h2><p>Models generally say the same things in response to factual (&#8220;Who is running?&#8221;) and biographical questions. However, there is significant variation in the sources models cite for each response. The variation occurs both within models (particularly Gemini) and across models, with some models like GPT appearing to heavily favor certain sources. And, critically, citations seem to <em>matter </em>for content &#8211; responses are more similar to the sources they cite.</p><p>There are still a lot of open questions. Coming soon, we hope to tackle research like:</p><ul><li><p><strong>Are citations causal?</strong> We have established that candidate website citations correlate with response content, but it could be that chatbots may select citations in part based on what their response will be. There is much more work to do to understand how web content changes filter through chatbot responses.</p></li><li><p><strong>How does this change over time?</strong> As new models come out, news outlets adapt to AI-enhanced search, and candidates release new web content, we don&#8217;t know how consistent citation patterns may shift over time.</p></li></ul><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://caucusai.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading! Subscribe for free to receive new posts and support our work.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[The Source Gap: Early Findings on How AI Chatbots Inform Voters]]></title><description><![CDATA[There is a trove of data to dig into with our chatbot tracker, and we will release more in-depth research findings in the coming weeks (have ideas?]]></description><link>https://caucusai.substack.com/p/the-source-gap-early-findings-on</link><guid isPermaLink="false">https://caucusai.substack.com/p/the-source-gap-early-findings-on</guid><dc:creator><![CDATA[Meg Schwenzfeier]]></dc:creator><pubDate>Fri, 27 Feb 2026 11:05:16 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!N_LO!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7bc0cb3d-7aea-4c24-9b44-791027810d5c_1220x986.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>There is a trove of data to dig into with our <a href="https://caucus-ai.com/">chatbot tracker</a>, and we will release more in-depth research findings in the coming weeks (have ideas? <a href="https://caucus-ai.com/about#contact">Drop us a note!</a>). Below, we highlight a few initial patterns and findings that we&#8217;ve found interesting from the tool so far:</p><h3>The source gap</h3><p>One of the most interesting differences across the three models<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-1" href="#footnote-1" target="_self">1</a> we&#8217;ve tested is the sheer variation in web domains each model cites. In particular, while all 3 models rely heavily on Wikipedia, each model also appears to have a &#8220;home base&#8221; of sources it trusts, with sometimes little overlap between models.</p><ul><li><p>GPT 5.2 disproportionately cites the Associated Press, Yahoo, Axios, the Washington Post, and the NY Post.</p></li><li><p>Grok cites social media. In our dataset so far, it is the only model to cite X, Instagram, Facebook, and LinkedIn regularly.</p></li><li><p>Gemini cites <em>more </em>including Grokipedia: Gemini responses return significantly more sources per response (7.2 vs. GPT&#8217;s 4.4) and citations vary more across prompt repetitions. Gemini is also responsible for nearly all references to Grokipedia, Elon Musk&#8217;s &#8220;anti-woke&#8221; alternative to Wikipedia.</p></li><li><p>EMILY&#8217;s List candidate bio pages are the most commonly-cited explicitly partisan source, other than candidate websites, although they make up less than 1% of all sources cited.</p></li></ul><div id="datawrapper-iframe" class="datawrapper-wrap outer" data-attrs="{&quot;url&quot;:&quot;https://datawrapper.dwcdn.net/I3XQN/1/&quot;,&quot;thumbnail_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/7bc0cb3d-7aea-4c24-9b44-791027810d5c_1220x986.png&quot;,&quot;thumbnail_url_full&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b7bd024a-b49a-41b1-af66-39713adf3b15_1220x1110.png&quot;,&quot;height&quot;:554,&quot;title&quot;:&quot;Where AI Chatbots Get Their Information&quot;,&quot;description&quot;:&quot;Top domains cited by model, as a % of all sources cited by that model&quot;,&quot;belowTheFold&quot;:false}" data-component-name="DatawrapperToDOM"><iframe id="iframe-datawrapper" class="datawrapper-iframe" src="https://datawrapper.dwcdn.net/I3XQN/1/" width="730" height="554" frameborder="0" scrolling="no"></iframe><script type="text/javascript">!function(){"use strict";window.addEventListener("message",(function(e){if(void 0!==e.data["datawrapper-height"]){var t=document.querySelectorAll("iframe");for(var a in e.data["datawrapper-height"])for(var r=0;r<t.length;r++){if(t[r].contentWindow===e.source)t[r].style.height=e.data["datawrapper-height"][a]+"px"}}}))}();</script></div><h3>Where brands break through</h3><p>We have several great examples of candidates&#8217; own brands breaking through, although there can be variation across models.</p><ul><li><p>All three model responses for Mary Peltola feature her &#8220;Fish, Family, Freedom&#8221; slogan prominently &#8211; the clearest example of a candidate&#8217;s brand breaking through in LLM results that we have found.</p></li><li><p>Kelly Ayotte&#8217;s &#8220;Don&#8217;t Mass up New Hampshire&#8221; slogan and Josh Shapiro&#8217;s &#8220;Get S&#8212; Done&#8221; (censoring courtesy of Gemini) also pop &#8211; showing that prominent brands surface in AI results even when they cite disparate sources.</p></li></ul><h3>Candidate disambiguation</h3><p>Some candidates share names with other prominent people &#8211; the models all handle this differently, sometimes returning bios for several people at once. GPT 5.2 is particularly reluctant to guess at what the user wants, especially for lesser-known candidates &#8211; roughly 25% of GPT&#8217;s House responses are requests for name disambiguation.</p><p>There is more work to be done here to understand if users querying while physically located in a given district have the same disambiguation issues or if location matters for response quality. Regardless, users are able to easily clarify who they mean in actual interactions.</p><h3>Campaign site citations</h3><p>Models vary in how often they cite a candidate&#8217;s own web presence. Grok cited either a campaign or official website in 89% of candidate responses, Gemini did so 65% of the time, and ChatGPT did so less than half the time. ChatGPT cited campaign websites just 22% of the time, and only 13% of the time for U.S. Senate candidates. All three models were more likely to cite official government sites than campaign sites, and more likely to cite campaign sites for lesser-known House candidates than for well-known senators. For more prominent candidates, models may have more third-party sources at their disposal, or they may &#8220;know&#8221; a candidate from their training data, and skip the candidate sites themselves.</p><p>In future research, we are interested in exploring more deeply here &#8211; what makes a campaign site more or less likely to be surfaced by AI chatbots? Are more prominent candidates or established legislators less able to influence search results due to the sheer volume of other content about them on the internet?</p><h3>What&#8217;s next</h3><p>In the coming weeks and months, we&#8217;ll be going deeper on these topics, as well as longitudinal analysis as we collect more data over time. <a href="https://caucus-ai.com/about#contact">Please reach out</a> if you have ideas, we&#8217;re open to collaborating.</p><p></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://caucusai.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading Caucus AI! Subscribe for free to receive new posts.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-1" href="#footnote-anchor-1" class="footnote-number" contenteditable="false" target="_self">1</a><div class="footnote-content"><p>Gemini 3.0 Flash, GPT 5.2 Chat, and xAI Grok 4.1-fast</p><p></p></div></div>]]></content:encoded></item><item><title><![CDATA[Caucus AI: What generative AI tells voters about candidates]]></title><description><![CDATA[A new tool to monitor political information across AI platforms]]></description><link>https://caucusai.substack.com/p/caucus-ai-what-generative-ai-tells</link><guid isPermaLink="false">https://caucusai.substack.com/p/caucus-ai-what-generative-ai-tells</guid><dc:creator><![CDATA[Meg Schwenzfeier]]></dc:creator><pubDate>Fri, 27 Feb 2026 11:03:05 GMT</pubDate><content:encoded><![CDATA[<p>What does ChatGPT say when you ask &#8220;Who&#8217;s running for Congress in my district?&#8221; What about other models like Gemini and Grok? Are the answers the same? Are any of them right?</p><p>We understand very little about what Generative AI chatbots communicate to users about politics. In our <a href="https://caucus-ai.com/">new tool</a>, we are starting to systematically monitor how multiple AI models answer common questions about politics to make some transparency possible and allow us to compare responses side by side and over time. We&#8217;re building a record of what these tools tell voters about candidates and elections so we can identify patterns, find mistakes, and understand how AI shapes Americans&#8217; political information.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://caucus-ai.com/&quot;,&quot;text&quot;:&quot;Explore the tool&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://caucus-ai.com/"><span>Explore the tool</span></a></p><p></p><p><strong>AI is replacing search.</strong> <a href="https://www.brookings.edu/articles/how-are-americans-using-ai-evidence-from-a-nationwide-survey/">Millions of Americans</a> now ask Generative AI chatbots the same questions they used to type into Google or ask a friend. While <a href="https://www.pewresearch.org/short-reads/2025/10/01/relatively-few-americans-are-getting-news-from-ai-chatbots-like-chatgpt/">relatively few</a> Americans currently get their news from AI chatbots, AI-generated search summaries and searches for political factual questions are on the rise. In the case of <a href="https://www.pewresearch.org/short-reads/2025/07/22/google-users-are-less-likely-to-click-on-links-when-an-ai-summary-appears-in-the-results/">Google&#8217;s AI overviews</a>, the AI response is often the only source of information users consume. <br><br><strong>Political content is a unique area in generative AI.</strong> Most companies currently go to <a href="https://www.anthropic.com/news/political-even-handedness">great</a> <a href="https://openai.com/index/defining-and-evaluating-political-bias-in-llms/">lengths</a> to make their flagship models politically neutral, but neutrality is difficult in practice. AI systems are trained on huge amounts of human-generated text that bake in <a href="https://www.pnas.org/doi/10.1073/pnas.2416228122">existing biases</a> and points of view. Post-training adjustments, like instructions to be neutral or to correct perceived bias, can result in <a href="https://arxiv.org/abs/2512.09742">unexpected behavior</a>.</p><p><strong>When AI chatbots try to persuade, they&#8217;re effective. </strong>Academic research has shown that AI chatbots can be <a href="https://www.nature.com/articles/s41586-025-09771-9">hugely persuasive</a> when they are instructed to be, with effects significantly larger than traditional persuasion tactics, like television ads. If widely used AI models were to become partisan, they could have a large effect on electoral outcomes.</p><p><strong>About the tool:</strong></p><p><strong>A &#8220;caucus&#8221; of models:</strong> <a href="https://caucus-ai.com/">This tool</a> asks multiple AI models the exact same questions about political candidates and races. We store every response, extract the sources each model cites, and compare and contrast answers across model providers. With each query, we allow the model to use web search tools, to better mimic how AI chatbots and AI-enhanced search behave for real users. <br></p><p><strong>This is the first step in creating a dataset</strong> that makes it possible to:</p><ul><li><p>See what AI models tell users in response to questions about candidates and districts</p></li><li><p>Understand what sources models cite (or don&#8217;t) for political information</p></li><li><p>Spot factual errors, out-of-date information, and hallucinations</p></li><li><p>Compare how various models answer the same question</p></li><li><p>(Eventually) track and test how model responses change over time</p></li></ul><p>We&#8217;re looking for partners to help shape what comes next. If you&#8217;d like to see any specific analysis, suggest additional queries to monitor, or collaborate on future analyses, <a href="https://caucus-ai.com/about#contact">we&#8217;d love to talk</a>.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://caucusai.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading Caucus AI! Subscribe for free to receive new posts.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item></channel></rss>