<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:itunes="http://www.itunes.com/dtds/podcast-1.0.dtd" xmlns:googleplay="http://www.google.com/schemas/play-podcasts/1.0"><channel><title><![CDATA[Thomas Jiralerspong]]></title><description><![CDATA[Essays on research, AI, and life.]]></description><link>https://blog.thomas.jiralerspong.com</link><image><url>https://blog.thomas.jiralerspong.com/img/substack.png</url><title>Thomas Jiralerspong</title><link>https://blog.thomas.jiralerspong.com</link></image><generator>Substack</generator><lastBuildDate>Thu, 19 Nov 2026 05:43:04 GMT</lastBuildDate><atom:link href="https://blog.thomas.jiralerspong.com/feed" rel="self" type="application/rss+xml"/><copyright><![CDATA[Thomas Jiralerspong]]></copyright><language><![CDATA[en]]></language><webMaster><![CDATA[thomasjiralerspong@substack.com]]></webMaster><itunes:owner><itunes:email><![CDATA[thomasjiralerspong@substack.com]]></itunes:email><itunes:name><![CDATA[Thomas Jiralerspong]]></itunes:name></itunes:owner><itunes:author><![CDATA[Thomas Jiralerspong]]></itunes:author><googleplay:owner><![CDATA[thomasjiralerspong@substack.com]]></googleplay:owner><googleplay:email><![CDATA[thomasjiralerspong@substack.com]]></googleplay:email><googleplay:author><![CDATA[Thomas Jiralerspong]]></googleplay:author><itunes:block><![CDATA[Yes]]></itunes:block><item><title><![CDATA[Chasing the Karpathy Peak (and Falling Off Slop Cliff): Confessions from Slopaholics Anonymous]]></title><description><![CDATA[How I became a slopaholic, who&#8217;s most at risk, and how to avoid it (or recover)]]></description><link>https://blog.thomas.jiralerspong.com/p/chasing-the-karpathy-peak</link><guid isPermaLink="false">https://blog.thomas.jiralerspong.com/p/chasing-the-karpathy-peak</guid><dc:creator><![CDATA[Thomas Jiralerspong]]></dc:creator><pubDate>Tue, 27 Oct 2026 22:16:45 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/2b5e8966-3802-4f6f-9c60-1432ac7c9299_1200x630.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!IEe1!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F527a4afc-71a4-4054-9327-25d2bfe08aa7_1800x1400.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!IEe1!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F527a4afc-71a4-4054-9327-25d2bfe08aa7_1800x1400.png 424w, https://substackcdn.com/image/fetch/$s_!IEe1!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F527a4afc-71a4-4054-9327-25d2bfe08aa7_1800x1400.png 848w, https://substackcdn.com/image/fetch/$s_!IEe1!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F527a4afc-71a4-4054-9327-25d2bfe08aa7_1800x1400.png 1272w, https://substackcdn.com/image/fetch/$s_!IEe1!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F527a4afc-71a4-4054-9327-25d2bfe08aa7_1800x1400.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!IEe1!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F527a4afc-71a4-4054-9327-25d2bfe08aa7_1800x1400.png" width="1456" height="1132" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/527a4afc-71a4-4054-9327-25d2bfe08aa7_1800x1400.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1132,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;AI Productivity Mountain: stick figures climb from Autocomplete Alley through Vibecoding Valley and the Agentic Ascent to Karpathy Peak. Past the peak the curve drops straight down Slop Cliff, where a spiral-eyed stick figure labeled ME sits at a laptop dreaming of working at the summit with a crown, right next to the Pit of Psychosis.&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="AI Productivity Mountain: stick figures climb from Autocomplete Alley through Vibecoding Valley and the Agentic Ascent to Karpathy Peak. Past the peak the curve drops straight down Slop Cliff, where a spiral-eyed stick figure labeled ME sits at a laptop dreaming of working at the summit with a crown, right next to the Pit of Psychosis." title="AI Productivity Mountain: stick figures climb from Autocomplete Alley through Vibecoding Valley and the Agentic Ascent to Karpathy Peak. Past the peak the curve drops straight down Slop Cliff, where a spiral-eyed stick figure labeled ME sits at a laptop dreaming of working at the summit with a crown, right next to the Pit of Psychosis." srcset="https://substackcdn.com/image/fetch/$s_!IEe1!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F527a4afc-71a4-4054-9327-25d2bfe08aa7_1800x1400.png 424w, https://substackcdn.com/image/fetch/$s_!IEe1!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F527a4afc-71a4-4054-9327-25d2bfe08aa7_1800x1400.png 848w, https://substackcdn.com/image/fetch/$s_!IEe1!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F527a4afc-71a4-4054-9327-25d2bfe08aa7_1800x1400.png 1272w, https://substackcdn.com/image/fetch/$s_!IEe1!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F527a4afc-71a4-4054-9327-25d2bfe08aa7_1800x1400.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>Ballmer Peak</h2><p>If you&#8217;re reading this, you may have heard of the <a href="https://xkcd.com/323/">Ballmer Peak</a>. Randall Munroe&#8217;s xkcd comic proposes a very specific level of drunkenness that supposedly gives you superhuman programming ability.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!hmt_!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab6517ea-d46f-444f-abbc-b188c1a4c3cd_652x592.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!hmt_!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab6517ea-d46f-444f-abbc-b188c1a4c3cd_652x592.png 424w, https://substackcdn.com/image/fetch/$s_!hmt_!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab6517ea-d46f-444f-abbc-b188c1a4c3cd_652x592.png 848w, https://substackcdn.com/image/fetch/$s_!hmt_!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab6517ea-d46f-444f-abbc-b188c1a4c3cd_652x592.png 1272w, https://substackcdn.com/image/fetch/$s_!hmt_!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab6517ea-d46f-444f-abbc-b188c1a4c3cd_652x592.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!hmt_!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab6517ea-d46f-444f-abbc-b188c1a4c3cd_652x592.png" width="652" height="592" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/ab6517ea-d46f-444f-abbc-b188c1a4c3cd_652x592.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:592,&quot;width&quot;:652,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;xkcd's Ballmer Peak graph: programming skill versus blood alcohol concentration, with a narrow spike of superhuman skill.&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="xkcd's Ballmer Peak graph: programming skill versus blood alcohol concentration, with a narrow spike of superhuman skill." title="xkcd's Ballmer Peak graph: programming skill versus blood alcohol concentration, with a narrow spike of superhuman skill." srcset="https://substackcdn.com/image/fetch/$s_!hmt_!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab6517ea-d46f-444f-abbc-b188c1a4c3cd_652x592.png 424w, https://substackcdn.com/image/fetch/$s_!hmt_!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab6517ea-d46f-444f-abbc-b188c1a4c3cd_652x592.png 848w, https://substackcdn.com/image/fetch/$s_!hmt_!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab6517ea-d46f-444f-abbc-b188c1a4c3cd_652x592.png 1272w, https://substackcdn.com/image/fetch/$s_!hmt_!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab6517ea-d46f-444f-abbc-b188c1a4c3cd_652x592.png 1456w" sizes="100vw"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><em>Comic: <a href="https://xkcd.com/323/">xkcd #323, &#8220;Ballmer Peak&#8221;</a> by Randall Munroe, used under <a href="https://xkcd.com/license.html">CC BY-NC 2.5</a>. The hand-drawn charts in the rest of this post are made in xkcd&#8217;s style, using the <a href="https://github.com/ipython/xkcd-font">xkcd Script font</a>.</em></p><p>One of my favorite papers involves people <a href="https://arxiv.org/abs/2404.10002">actually trying to find the Ballmer Peak</a> by drinking and doing LeetCode for SIGBOVIK, a comedy research conference. They report a benefit from a low amount of alcohol (slightly less than two drinks).</p><p>Based on this extremely rigorous result, we will assume the Ballmer Peak is real for the rest of this post. I&#8217;d remembered the graph as a smoother climb followed by a cliff, so that&#8217;s the shape I&#8217;m borrowing:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!XtI6!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5588448b-fa54-4645-8e5c-4ff1c5a61c06_1800x1200.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!XtI6!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5588448b-fa54-4645-8e5c-4ff1c5a61c06_1800x1200.png 424w, https://substackcdn.com/image/fetch/$s_!XtI6!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5588448b-fa54-4645-8e5c-4ff1c5a61c06_1800x1200.png 848w, https://substackcdn.com/image/fetch/$s_!XtI6!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5588448b-fa54-4645-8e5c-4ff1c5a61c06_1800x1200.png 1272w, https://substackcdn.com/image/fetch/$s_!XtI6!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5588448b-fa54-4645-8e5c-4ff1c5a61c06_1800x1200.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!XtI6!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5588448b-fa54-4645-8e5c-4ff1c5a61c06_1800x1200.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/5588448b-fa54-4645-8e5c-4ff1c5a61c06_1800x1200.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Hand-drawn Ballmer Peak as remembered: skill climbs smoothly with alcohol, peaks, then drops off a cliff.&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Hand-drawn Ballmer Peak as remembered: skill climbs smoothly with alcohol, peaks, then drops off a cliff." title="Hand-drawn Ballmer Peak as remembered: skill climbs smoothly with alcohol, peaks, then drops off a cliff." srcset="https://substackcdn.com/image/fetch/$s_!XtI6!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5588448b-fa54-4645-8e5c-4ff1c5a61c06_1800x1200.png 424w, https://substackcdn.com/image/fetch/$s_!XtI6!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5588448b-fa54-4645-8e5c-4ff1c5a61c06_1800x1200.png 848w, https://substackcdn.com/image/fetch/$s_!XtI6!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5588448b-fa54-4645-8e5c-4ff1c5a61c06_1800x1200.png 1272w, https://substackcdn.com/image/fetch/$s_!XtI6!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5588448b-fa54-4645-8e5c-4ff1c5a61c06_1800x1200.png 1456w" sizes="100vw"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><em>(Thanks Claude for clarifying that this is a metaphor and not real measurements, in case that wasn&#8217;t clear!)</em></p><h2>The Climb to Karpathy Peak</h2><p>I think the shape of using AI for productivity follows a similar curve, so let&#8217;s relabel the axes. Let&#8217;s also give it a name: AI Productivity Mountain. Everyone&#8217;s (or at least everyone in the Bay Area&#8217;s) goal is to get as high as possible on AI Productivity Mountain, to reach the mythical Karpathy Peak.</p><blockquote><p><strong>Karpathy Peak</strong> <em>(n.)</em>: the point where you&#8217;re getting as much useful work out of AI as <a href="https://x.com/karpathy/status/1886192184808149383">the inventor of vibe coding himself</a>.</p></blockquote><p>I&#8217;ll describe the climb through my own experience using AI for AI research, since that&#8217;s what I know best, but I suspect it looks pretty similar for a lot of other work.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!JYd1!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2120cf47-d30e-4e06-8ff0-e07f6a79887f_1800x1200.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!JYd1!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2120cf47-d30e-4e06-8ff0-e07f6a79887f_1800x1200.png 424w, https://substackcdn.com/image/fetch/$s_!JYd1!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2120cf47-d30e-4e06-8ff0-e07f6a79887f_1800x1200.png 848w, https://substackcdn.com/image/fetch/$s_!JYd1!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2120cf47-d30e-4e06-8ff0-e07f6a79887f_1800x1200.png 1272w, https://substackcdn.com/image/fetch/$s_!JYd1!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2120cf47-d30e-4e06-8ff0-e07f6a79887f_1800x1200.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!JYd1!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2120cf47-d30e-4e06-8ff0-e07f6a79887f_1800x1200.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/2120cf47-d30e-4e06-8ff0-e07f6a79887f_1800x1200.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Hand-drawn AI Productivity Mountain with a stick figure at each stage: checking autocomplete through a magnifying glass in Autocomplete Alley, vibecoding with a coffee in Vibecoding Valley, sending agents up the Agentic Ascent, and a crowned figure working with five agents beside the Karpathy Peak flag.&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Hand-drawn AI Productivity Mountain with a stick figure at each stage: checking autocomplete through a magnifying glass in Autocomplete Alley, vibecoding with a coffee in Vibecoding Valley, sending agents up the Agentic Ascent, and a crowned figure working with five agents beside the Karpathy Peak flag." title="Hand-drawn AI Productivity Mountain with a stick figure at each stage: checking autocomplete through a magnifying glass in Autocomplete Alley, vibecoding with a coffee in Vibecoding Valley, sending agents up the Agentic Ascent, and a crowned figure working with five agents beside the Karpathy Peak flag." srcset="https://substackcdn.com/image/fetch/$s_!JYd1!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2120cf47-d30e-4e06-8ff0-e07f6a79887f_1800x1200.png 424w, https://substackcdn.com/image/fetch/$s_!JYd1!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2120cf47-d30e-4e06-8ff0-e07f6a79887f_1800x1200.png 848w, https://substackcdn.com/image/fetch/$s_!JYd1!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2120cf47-d30e-4e06-8ff0-e07f6a79887f_1800x1200.png 1272w, https://substackcdn.com/image/fetch/$s_!JYd1!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2120cf47-d30e-4e06-8ff0-e07f6a79887f_1800x1200.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Everyone starts the same way, with a few careful steps through Autocomplete Alley. At first, you&#8217;re skeptical, so you check everything. Then, the model gets enough things right that checking starts to feel like a waste of time. Why keep approving each function when you could ask for the whole feature? Welcome to Vibecoding Valley.</p><p>You start to climb higher, onto the Agentic Ascent. &#8220;Build this feature&#8221; becomes &#8220;run this experiment,&#8221; then &#8220;run these experiments overnight and write up the results.&#8221; At every step, you trust that the layers below you are solid.</p><p>You go faster and faster. 1 experiment per day turns into 2, then 5, then 10. You can&#8217;t type fast enough so you start using voice mode. You can feel it. Karpathy Peak is right ahead. You&#8217;re being so productive. It feels so good.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!FHSV!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F34818f0a-7f2d-4778-a99f-b78fadb4a5d1_1800x1200.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!FHSV!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F34818f0a-7f2d-4778-a99f-b78fadb4a5d1_1800x1200.png 424w, https://substackcdn.com/image/fetch/$s_!FHSV!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F34818f0a-7f2d-4778-a99f-b78fadb4a5d1_1800x1200.png 848w, https://substackcdn.com/image/fetch/$s_!FHSV!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F34818f0a-7f2d-4778-a99f-b78fadb4a5d1_1800x1200.png 1272w, https://substackcdn.com/image/fetch/$s_!FHSV!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F34818f0a-7f2d-4778-a99f-b78fadb4a5d1_1800x1200.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!FHSV!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F34818f0a-7f2d-4778-a99f-b78fadb4a5d1_1800x1200.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/34818f0a-7f2d-4778-a99f-b78fadb4a5d1_1800x1200.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Zoomed-in view of a stick figure running up the Agentic Ascent past a wall of agent monitors, shouting 10 experiments a day.&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Zoomed-in view of a stick figure running up the Agentic Ascent past a wall of agent monitors, shouting 10 experiments a day." title="Zoomed-in view of a stick figure running up the Agentic Ascent past a wall of agent monitors, shouting 10 experiments a day." srcset="https://substackcdn.com/image/fetch/$s_!FHSV!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F34818f0a-7f2d-4778-a99f-b78fadb4a5d1_1800x1200.png 424w, https://substackcdn.com/image/fetch/$s_!FHSV!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F34818f0a-7f2d-4778-a99f-b78fadb4a5d1_1800x1200.png 848w, https://substackcdn.com/image/fetch/$s_!FHSV!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F34818f0a-7f2d-4778-a99f-b78fadb4a5d1_1800x1200.png 1272w, https://substackcdn.com/image/fetch/$s_!FHSV!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F34818f0a-7f2d-4778-a99f-b78fadb4a5d1_1800x1200.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>You stop to look at your results. You beat the baseline by 15%! Excited, you show your experiments to your friend/collaborator/supervisor.</p><blockquote><p><strong>Friend:</strong> &#8220;Nice! What dataset did you use?&#8221;</p></blockquote><p>You think and realize you don&#8217;t know. You&#8217;ve long stopped worrying about silly details like that. No worries, your LLM will know.</p><blockquote><p><strong>You:</strong> &#8220;What data did you use for the experiment?&#8221;</p><p><strong>LLM:</strong> &#8220;Let me verify instead of telling you from memory!&#8221;</p><p><strong>LLM:</strong> [Works for 120 seconds]</p><p><strong>LLM:</strong> &#8220;I was not able to access the data required, so I generated synthetic data instead. [100 more lines of yapping]&#8221;</p><p><strong>You:</strong> &lt;think&gt; &#8220;Oh that&#8217;s fine everyone uses <a href="https://thomas.jiralerspong.com/blog/persona-vectors-and-real-data/">synthetic data</a> these days&#8221; &lt;/think&gt;</p><p><strong>You:</strong> &#8220;How did you generate the synthetic data?&#8221;</p><p><strong>LLM:</strong> &#8220;Let me look at the actual experimental code instead of guessing.&#8221;</p><p><strong>LLM:</strong> [Works for 150 seconds]</p><p><strong>LLM:</strong> &#8220;I generated data by applying dumb programmatic rules. There are only 5 distinct datapoints in your dataset of 1000. [100 more lines of yapping]&#8221;</p></blockquote><p>Your vision blurs. Your body erupts in pain. You shake your head, dazed, as if a spell has been lifted. You&#8217;re crawling on the ground, palms scraped raw, gravel stuck in your knees. You look around. Where are you? Where did the sunny mountainside go? You look up. You see Karpathy Peak far above you. You&#8217;re not on AI Productivity Mountain anymore.</p><p>You&#8217;ve fallen off Slop Cliff.</p><h2>Slop Cliff</h2><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!IhTk!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffed39d90-ac10-41f9-adf0-d6b8476ff61f_1800x1200.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!IhTk!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffed39d90-ac10-41f9-adf0-d6b8476ff61f_1800x1200.png 424w, https://substackcdn.com/image/fetch/$s_!IhTk!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffed39d90-ac10-41f9-adf0-d6b8476ff61f_1800x1200.png 848w, https://substackcdn.com/image/fetch/$s_!IhTk!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffed39d90-ac10-41f9-adf0-d6b8476ff61f_1800x1200.png 1272w, https://substackcdn.com/image/fetch/$s_!IhTk!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffed39d90-ac10-41f9-adf0-d6b8476ff61f_1800x1200.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!IhTk!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffed39d90-ac10-41f9-adf0-d6b8476ff61f_1800x1200.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/fed39d90-ac10-41f9-adf0-d6b8476ff61f_1800x1200.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;The full AI Productivity Mountain: right after the Karpathy Peak flag the curve drops straight down Slop Cliff, where a spiral-eyed stick figure sits at a laptop dreaming of working at the summit with a crown.&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="The full AI Productivity Mountain: right after the Karpathy Peak flag the curve drops straight down Slop Cliff, where a spiral-eyed stick figure sits at a laptop dreaming of working at the summit with a crown." title="The full AI Productivity Mountain: right after the Karpathy Peak flag the curve drops straight down Slop Cliff, where a spiral-eyed stick figure sits at a laptop dreaming of working at the summit with a crown." srcset="https://substackcdn.com/image/fetch/$s_!IhTk!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffed39d90-ac10-41f9-adf0-d6b8476ff61f_1800x1200.png 424w, https://substackcdn.com/image/fetch/$s_!IhTk!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffed39d90-ac10-41f9-adf0-d6b8476ff61f_1800x1200.png 848w, https://substackcdn.com/image/fetch/$s_!IhTk!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffed39d90-ac10-41f9-adf0-d6b8476ff61f_1800x1200.png 1272w, https://substackcdn.com/image/fetch/$s_!IhTk!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffed39d90-ac10-41f9-adf0-d6b8476ff61f_1800x1200.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><blockquote><p><strong>Slop Cliff</strong> <em>(n.)</em>: the point where your actual productivity with AI drops off while your perceived productivity keeps climbing.</p></blockquote><p>I&#8217;m embarrassed to say something very similar to the story above happened to me a few months ago. At first, I was really ashamed. But as I&#8217;ve talked to more and more people, I&#8217;ve realized this is a relatively common experience, so I wanted to write about it.</p><p>I think it can help to go back to the Ballmer Peak&#8217;s original subject: alcohol. Let&#8217;s also generalize this to some other drugs. Alcohol, weed, and shrooms can all produce versions of the same experience: feeling much more capable than you actually are. Either you&#8217;re on weed/shrooms and you think you&#8217;ve solved the meaning of life, or you&#8217;re drunk and you think you can easily jump over a 2 meter tall fence.</p><p>Then you wake up the next day, reread your brilliant insight, and realize that &#8220;everything is connected because everything is everything&#8221; might not get into Nature after all, or you try jumping over the fence and end up in the emergency room (Definitely not speaking from personal experience...). Studies also support this gap between feeling capable and performing well with <a href="https://doi.org/10.1111/manc.12439">alcohol</a>, <a href="https://doi.org/10.1037/apl0000599">weed</a>, and <a href="https://www.nature.com/articles/s41398-021-01335-5">shrooms</a>.</p><p>Assuming the Ballmer Peak is real, we can therefore add a second line to the chart:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!cMRU!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5238ed16-a373-4889-8ac0-67ecd48deada_1800x1200.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!cMRU!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5238ed16-a373-4889-8ac0-67ecd48deada_1800x1200.png 424w, https://substackcdn.com/image/fetch/$s_!cMRU!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5238ed16-a373-4889-8ac0-67ecd48deada_1800x1200.png 848w, https://substackcdn.com/image/fetch/$s_!cMRU!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5238ed16-a373-4889-8ac0-67ecd48deada_1800x1200.png 1272w, https://substackcdn.com/image/fetch/$s_!cMRU!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5238ed16-a373-4889-8ac0-67ecd48deada_1800x1200.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!cMRU!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5238ed16-a373-4889-8ac0-67ecd48deada_1800x1200.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/5238ed16-a373-4889-8ac0-67ecd48deada_1800x1200.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Ballmer Peak with two lines: actual capability falls off a cliff while perceived capability keeps climbing.&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Ballmer Peak with two lines: actual capability falls off a cliff while perceived capability keeps climbing." title="Ballmer Peak with two lines: actual capability falls off a cliff while perceived capability keeps climbing." srcset="https://substackcdn.com/image/fetch/$s_!cMRU!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5238ed16-a373-4889-8ac0-67ecd48deada_1800x1200.png 424w, https://substackcdn.com/image/fetch/$s_!cMRU!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5238ed16-a373-4889-8ac0-67ecd48deada_1800x1200.png 848w, https://substackcdn.com/image/fetch/$s_!cMRU!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5238ed16-a373-4889-8ac0-67ecd48deada_1800x1200.png 1272w, https://substackcdn.com/image/fetch/$s_!cMRU!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5238ed16-a373-4889-8ac0-67ecd48deada_1800x1200.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>I think the curve with AI looks similar:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!qN61!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc05a5811-abd8-4c4b-86ad-f8a4ba1d5f28_1800x1200.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!qN61!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc05a5811-abd8-4c4b-86ad-f8a4ba1d5f28_1800x1200.png 424w, https://substackcdn.com/image/fetch/$s_!qN61!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc05a5811-abd8-4c4b-86ad-f8a4ba1d5f28_1800x1200.png 848w, https://substackcdn.com/image/fetch/$s_!qN61!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc05a5811-abd8-4c4b-86ad-f8a4ba1d5f28_1800x1200.png 1272w, https://substackcdn.com/image/fetch/$s_!qN61!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc05a5811-abd8-4c4b-86ad-f8a4ba1d5f28_1800x1200.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!qN61!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc05a5811-abd8-4c4b-86ad-f8a4ba1d5f28_1800x1200.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c05a5811-abd8-4c4b-86ad-f8a4ba1d5f28_1800x1200.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;AI Productivity Mountain with two lines: actual productivity falls off Slop Cliff while perceived productivity keeps climbing.&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="AI Productivity Mountain with two lines: actual productivity falls off Slop Cliff while perceived productivity keeps climbing." title="AI Productivity Mountain with two lines: actual productivity falls off Slop Cliff while perceived productivity keeps climbing." srcset="https://substackcdn.com/image/fetch/$s_!qN61!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc05a5811-abd8-4c4b-86ad-f8a4ba1d5f28_1800x1200.png 424w, https://substackcdn.com/image/fetch/$s_!qN61!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc05a5811-abd8-4c4b-86ad-f8a4ba1d5f28_1800x1200.png 848w, https://substackcdn.com/image/fetch/$s_!qN61!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc05a5811-abd8-4c4b-86ad-f8a4ba1d5f28_1800x1200.png 1272w, https://substackcdn.com/image/fetch/$s_!qN61!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc05a5811-abd8-4c4b-86ad-f8a4ba1d5f28_1800x1200.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Since I&#8217;ve started writing blog posts, writing is where I notice it most. Anyone who has tried writing (well) with AI knows the feeling. You spend an hour having it rewrite a passage a million times, finally get frustrated, go in and do it yourself, and realize you could have just done it in 10 minutes and saved yourself the trouble. I do think AI is useful for helping me realize how I <strong>don&#8217;t</strong> want to write, which then makes the writing process much easier, but I&#8217;m ironically still unsure how much to use it for this.</p><p>Studies show the same pattern: in <a href="https://metr.org/blog/2025-07-10-early-2025-ai-experienced-os-dev-study/">METR&#8217;s early-2025 randomized study</a>, 16 experienced open-source developers working in their own repositories took 19% longer to finish tasks with AI, but afterward estimated that it had made them 20% faster. This shows that, even for experienced developers, and even in an area where AI is supposed to show the most gains, self-assessing the productivity gains of AI is difficult.</p><p>We&#8217;ve definitely come a long way from then, and I don&#8217;t think that anyone would now dispute that AI gives <a href="https://www.nber.org/papers/w35275">real productivity gains for coding</a>. But better tools don&#8217;t necessarily make us better judges of how much they&#8217;re helping.</p><p>And if you don&#8217;t notice you&#8217;ve fallen off Slop Cliff, you can keep going down. The further you get from doing the work yourself, the harder it is to climb back out: you understand less of what the AI is doing, so you lean on it more, so you understand even less. Eventually you end up in the Pit of Psychosis, announcing <a href="https://www.cbc.ca/lite/story/1.7631925">groundbreaking new math frameworks</a>, getting <a href="https://futurism.com/former-ceo-uber-ai">&#8220;pretty damn close&#8221; to breakthroughs in quantum physics</a>, or uncovering <a href="https://futurism.com/tech-industry-ai-mental-health">shadowy non-governmental agencies</a>.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!gK5n!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd838a7ad-de07-4667-a952-14767119394e_1800x1400.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!gK5n!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd838a7ad-de07-4667-a952-14767119394e_1800x1400.png 424w, https://substackcdn.com/image/fetch/$s_!gK5n!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd838a7ad-de07-4667-a952-14767119394e_1800x1400.png 848w, https://substackcdn.com/image/fetch/$s_!gK5n!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd838a7ad-de07-4667-a952-14767119394e_1800x1400.png 1272w, https://substackcdn.com/image/fetch/$s_!gK5n!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd838a7ad-de07-4667-a952-14767119394e_1800x1400.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!gK5n!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd838a7ad-de07-4667-a952-14767119394e_1800x1400.png" width="1456" height="1132" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d838a7ad-de07-4667-a952-14767119394e_1800x1400.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1132,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;AI Productivity Mountain: past Slop Cliff a short ledge slopes down into the Pit of Psychosis, where a spiral-eyed figure dives head first while imagining himself flying away like an astronaut. The perceived-productivity line keeps climbing.&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="AI Productivity Mountain: past Slop Cliff a short ledge slopes down into the Pit of Psychosis, where a spiral-eyed figure dives head first while imagining himself flying away like an astronaut. The perceived-productivity line keeps climbing." title="AI Productivity Mountain: past Slop Cliff a short ledge slopes down into the Pit of Psychosis, where a spiral-eyed figure dives head first while imagining himself flying away like an astronaut. The perceived-productivity line keeps climbing." srcset="https://substackcdn.com/image/fetch/$s_!gK5n!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd838a7ad-de07-4667-a952-14767119394e_1800x1400.png 424w, https://substackcdn.com/image/fetch/$s_!gK5n!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd838a7ad-de07-4667-a952-14767119394e_1800x1400.png 848w, https://substackcdn.com/image/fetch/$s_!gK5n!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd838a7ad-de07-4667-a952-14767119394e_1800x1400.png 1272w, https://substackcdn.com/image/fetch/$s_!gK5n!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd838a7ad-de07-4667-a952-14767119394e_1800x1400.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>Slopaholics Anonymous</h2><p>My name is Thomas, and I used to be a slopaholic.</p><blockquote><p><strong>Slopaholic</strong> <em>(n.)</em>: someone who is addicted to the feeling of using AI past the point when it is having a positive effect on their life/productivity</p></blockquote><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!-eeC!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6dd176ec-2038-4f4c-bee6-17cfd1159f96_1800x1200.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!-eeC!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6dd176ec-2038-4f4c-bee6-17cfd1159f96_1800x1200.png 424w, https://substackcdn.com/image/fetch/$s_!-eeC!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6dd176ec-2038-4f4c-bee6-17cfd1159f96_1800x1200.png 848w, https://substackcdn.com/image/fetch/$s_!-eeC!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6dd176ec-2038-4f4c-bee6-17cfd1159f96_1800x1200.png 1272w, https://substackcdn.com/image/fetch/$s_!-eeC!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6dd176ec-2038-4f4c-bee6-17cfd1159f96_1800x1200.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!-eeC!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6dd176ec-2038-4f4c-bee6-17cfd1159f96_1800x1200.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/6dd176ec-2038-4f4c-bee6-17cfd1159f96_1800x1200.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;A Slopaholics Anonymous meeting inside a Faraday cage: disheveled people in a circle, one saying my name is Thomas and I'm a slopaholic, another still trying to prompt on his phone.&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="A Slopaholics Anonymous meeting inside a Faraday cage: disheveled people in a circle, one saying my name is Thomas and I'm a slopaholic, another still trying to prompt on his phone." title="A Slopaholics Anonymous meeting inside a Faraday cage: disheveled people in a circle, one saying my name is Thomas and I'm a slopaholic, another still trying to prompt on his phone." srcset="https://substackcdn.com/image/fetch/$s_!-eeC!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6dd176ec-2038-4f4c-bee6-17cfd1159f96_1800x1200.png 424w, https://substackcdn.com/image/fetch/$s_!-eeC!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6dd176ec-2038-4f4c-bee6-17cfd1159f96_1800x1200.png 848w, https://substackcdn.com/image/fetch/$s_!-eeC!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6dd176ec-2038-4f4c-bee6-17cfd1159f96_1800x1200.png 1272w, https://substackcdn.com/image/fetch/$s_!-eeC!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6dd176ec-2038-4f4c-bee6-17cfd1159f96_1800x1200.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Feeling more capable than you are is one thing AI has in common with other drugs. Here are a few more, and some ways in which I think AI is actually worse</p><h3>What AI use has in common with drugs</h3><p><strong>It can give you a &#8220;high&#8221;:</strong> Productivity maxing people can get addicted to the &#8220;slop high&#8221;, i.e., the <a href="https://arxiv.org/html/2601.13348">feeling of being productive</a>. They think they&#8217;re optimizing their actual productivity (the red curve in the charts above), but what they&#8217;re really chasing is the feeling of productivity (the dotted line).</p><p><strong>It can be hard to stop:</strong> Once you get used to a certain level of perceived productivity, and feel like you&#8217;ve automated parts of your workflow (even if you&#8217;ve actually just slop-ified them), going back to doing things yourself feels both painfully slow and pointless. <strong>It negatively affects those around you:</strong> <a href="https://gptzero.me/news/iclr-2026/">Conferences and reviewers</a> are suffering under <a href="https://www.pangram.com/blog/pangram-predicts-21-of-iclr-reviews-are-ai-generated">mountains of slop</a>. People are having to deal with their <a href="https://www.betterup.com/workslop">coworkers&#8217; slop</a>. All this is incredibly <a href="https://hbr.org/2025/09/ai-generated-workslop-is-destroying-productivity">frustrating and time-wasting</a>.</p><p><strong>You can be a functioning AI overuser:</strong> Unless someone <strong>directly</strong> engages with the details of your work, it can be hard for people around you to see that you are overusing AI.</p><p><strong>It can end in tragedy:</strong> Alcohol and other drugs can lead to overdoses and drunk driving deaths. AI addiction has already been <a href="https://en.wikipedia.org/wiki/Deaths_linked_to_chatbots">linked to deaths</a>, and to people being <a href="https://futurism.com/commitment-jail-chatgpt-psychosis">involuntarily committed, jailed or fired</a>.</p><h3>Why AI Might Be Worse</h3><p><strong>AI usage doesn&#8217;t wear off naturally:</strong> With intoxication, there can be a next morning when you look at yesterday&#8217;s brilliant insights and realize that they are gibberish. AI usage has no built-in reset. You can keep delegating, then use the same tool to reassure yourself that the delegation is working. Going back down to a lower level of AI use feels like losing productivity, which never feels good.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!60cx!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F53c98b4e-1665-4f7c-9b38-66325f3db11c_1800x1200.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!60cx!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F53c98b4e-1665-4f7c-9b38-66325f3db11c_1800x1200.png 424w, https://substackcdn.com/image/fetch/$s_!60cx!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F53c98b4e-1665-4f7c-9b38-66325f3db11c_1800x1200.png 848w, https://substackcdn.com/image/fetch/$s_!60cx!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F53c98b4e-1665-4f7c-9b38-66325f3db11c_1800x1200.png 1272w, https://substackcdn.com/image/fetch/$s_!60cx!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F53c98b4e-1665-4f7c-9b38-66325f3db11c_1800x1200.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!60cx!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F53c98b4e-1665-4f7c-9b38-66325f3db11c_1800x1200.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/53c98b4e-1665-4f7c-9b38-66325f3db11c_1800x1200.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;The Slopaholic Cycle: hand AI a bigger task, feel so productive, ask AI if it worked, AI says it worked great, repeat. A faint exit arrow reads: check it yourself (rarely taken).&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="The Slopaholic Cycle: hand AI a bigger task, feel so productive, ask AI if it worked, AI says it worked great, repeat. A faint exit arrow reads: check it yourself (rarely taken)." title="The Slopaholic Cycle: hand AI a bigger task, feel so productive, ask AI if it worked, AI says it worked great, repeat. A faint exit arrow reads: check it yourself (rarely taken)." srcset="https://substackcdn.com/image/fetch/$s_!60cx!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F53c98b4e-1665-4f7c-9b38-66325f3db11c_1800x1200.png 424w, https://substackcdn.com/image/fetch/$s_!60cx!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F53c98b4e-1665-4f7c-9b38-66325f3db11c_1800x1200.png 848w, https://substackcdn.com/image/fetch/$s_!60cx!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F53c98b4e-1665-4f7c-9b38-66325f3db11c_1800x1200.png 1272w, https://substackcdn.com/image/fetch/$s_!60cx!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F53c98b4e-1665-4f7c-9b38-66325f3db11c_1800x1200.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><strong>High AI usage is actively encouraged by society (at least in tech):</strong> <a href="https://www.hrgrapevine.com/us/content/article/2026-02-05-meta-links-ai-adoption-usage-to-reviews-rewards">Many companies</a> are <a href="https://the-decoder.com/meta-employees-compete-for-token-consumption-on-an-internal-ai-leaderboard/">rewarding employees</a> for using as much AI as possible, without checking whether it&#8217;s making them more productive (<a href="https://finance.yahoo.com/sectors/technology/articles/amazon-says-shut-down-token-161016125.html">Amazon shut down its token leaderboard</a> after people started running pointless AI tasks just to rank higher). It&#8217;s like if your employer rewarded you for getting drunk every day (although <a href="https://employeebenefits.co.uk/total-reward/japanese-firm-trust-ring-offers-leave-for-hangovers-and-celebrity-announcements/280402.article">at least one company in Japan apparently gives employees time off for hangovers</a>).</p><h2>Is It an Actual Addiction?</h2><p>To be honest, I started writing this post as mostly a joke, but after reading a bunch of studies and reflecting on my own experience, I began to feel that AI use does have a lot of the markers of addiction.</p><p>So I looked up if it meets the criteria for an addiction. The answer seems to be &#8220;sort of.&#8221; Neither of the two big diagnostic manuals (<a href="https://www.psychiatry.org/psychiatrists/practice/dsm">DSM-5-TR</a> and <a href="https://icd.who.int/en">ICD-11</a>) lists AI addiction, and the closest thing they have is <a href="https://www.who.int/news-room/questions-and-answers/item/addictive-behaviours-gaming-disorder">gaming disorder</a>. But researchers have started measuring it anyway. In a <a href="https://www.frontiersin.org/journals/psychology/articles/10.3389/fpsyg.2026.1887507/full">2026 study of undergraduates</a>, daily AI users scored higher on every part of a new AI addiction scale. A <a href="https://arxiv.org/html/2601.13348">study of Reddit posts about chatbot addiction</a> describes an &#8220;epistemic rabbit hole&#8221; type that sounds a lot like a slopaholic to me: people who couldn&#8217;t stop asking questions and told themselves they were being productive.</p><p>I&#8217;m definitely not qualified to say whether all this adds up to a clinical addiction, but as someone who has experienced it firsthand, I can say that it was hard to stop and negatively impacted my life, which at least makes it fit the colloquial definition of an addiction in my eyes.</p><h2>&#8220;I Can Handle My Tokens&#8221;</h2><p>You might think you&#8217;re too smart (or know too much about AI) for this to happen to you. I think this is a bit like being the friend who swears they have a really high alcohol tolerance and is throwing up in the bathroom an hour later. From what I could find, being smarter or more knowledgeable about AI doesn&#8217;t protect you much:</p><ul><li><p>Anecdotally, the people in the Pit of Psychosis examples seem to be very smart and successful. The quantum physics claims came from <a href="https://en.wikipedia.org/wiki/Travis_Kalanick">Uber&#8217;s co-founder and former CEO</a>, and the shadowy agencies from <a href="https://bedrockcap.com/geoff-lewis">the founder of a venture firm</a> whose investments include OpenAI.</p></li><li><p>People who rated themselves as <a href="https://www.sciencedirect.com/science/article/pii/S0747563225002262">more AI literate were </a><em><a href="https://www.sciencedirect.com/science/article/pii/S0747563225002262">more</a></em><a href="https://www.sciencedirect.com/science/article/pii/S0747563225002262"> overconfident</a> about how well they did on LSAT logic questions (from the law school admissions test) with ChatGPT.</p></li><li><p>When people asked AI for advice on interpersonal conflicts, they rated an AI that <a href="https://www.science.org/doi/10.1126/science.aec8352">just took their side</a> as better advice and trusted it more, even when Reddit&#8217;s verdict was that they were in the wrong. This held no matter how much they normally used AI.</p></li><li><p>Even <a href="https://www.rsna.org/news/2023/may/ai-bias-may-impair-accuracy">radiologists with 15+ years of experience</a> dropped from 82% to 45.5% accuracy when an AI gave them wrong suggestions.</p></li><li><p>Higher cognitive ability <a href="https://skepdic.com/biasblindspot.html">doesn&#8217;t shrink the bias blind spot</a> (the tendency to notice biases in other people but not in yourself)</p></li><li><p><a href="https://papers.ssrn.com/abstract=2319992">More numerate people</a> are better at reasoning their way to what they already want to believe.</p></li></ul><h2>Risk Factors</h2><p>I don&#8217;t think anything can fully protect you from slopaholism, but I do think there are 5 things that make it more likely:</p><p><strong>Optimizer mindset</strong></p><p>If you&#8217;re obsessed with being as productive as possible, it&#8217;s easy to start chasing the <strong>feeling of being productive</strong> instead of <strong>actually being productive</strong> (basically <a href="https://en.wikipedia.org/wiki/Reward_hacking">reward hacking</a> your own brain).</p><p><strong>Social isolation</strong></p><p>If nobody is asking you questions about your work, it&#8217;s easier to keep convincing yourself you&#8217;re in control. When you work alone, or on a project nobody else looks at closely, the only checks on your results come from you and the same model that produced them, and the model will usually tell you everything looks great.</p><p><strong>Social pressure to use AI</strong></p><p>If everyone around you has miraculously automated their entire workflow (and is posting about it on X), it&#8217;s hard to not get the feeling that you should as well.</p><p><strong>Unlimited token availability</strong></p><p>Having at least some limits on the amount of tokens you use forces you to think a little before prompting. Without any limits, it becomes easy to go on autopilot and stop thinking about anything you&#8217;re doing.</p><p><strong>Being relatively new to a field</strong></p><p>It is hardest to tell that an AI is saying something that doesn&#8217;t make sense when you don&#8217;t have a lot of experience related to what the AI is talking about.</p><p>People in the tech scene (and especially at frontier labs) check a lot of these boxes (and, as we saw <a href="#&#167;i-can-handle-my-tokens">above</a>, being smart/knowledgeable about AI doesn&#8217;t give you a higher tolerance), which makes me a bit worried about how much to trust their <a href="https://blog.redwoodresearch.org/p/is-90-of-code-at-anthropic-being">predictions</a> <a href="https://www.scmp.com/tech/tech-trends/article/3258309/teslas-musk-predicts-ai-will-be-smarter-smartest-human-next-year">about AI</a> <a href="https://joshuagans.substack.com/p/radiologists-are-the-canaries-in">capabilities</a>, and might explain why <a href="https://capacityglobal.com/news/former-openai-researcher-pushes-back-agi-timeline/">they keep changing</a>. If you overestimate how much AI helps you day to day, it&#8217;s easy to overestimate how close it is to doing everything else too.</p><h2>Sobering Up</h2><p>Here are a few things that have helped me recover from slopaholism (and that might help you avoid it in the first place).</p><p><strong>Accepting that things take time</strong></p><p>AI makes it feel like a task <strong>shouldn&#8217;t</strong> take up your time, so doing it yourself starts to feel pointless. But things DO take time. If we could automate everything, we would have automated everything already. Psychologically accepting that fact helps a lot with avoiding the temptation to use AI when it will not help.</p><p><strong>Remembering that you can do things yourself</strong></p><p>The other thing AI convinces you of is that <strong>you&#8217;ve lost the ability to do something yourself</strong>, which makes going back feel really hard. The fastest way I know to fix this is going cold turkey for a while: back to the old days of 2022, cutting down to 0. It&#8217;s a quick way to prove to yourself that you can still do things well WITHOUT AI.</p><p><strong>Looking back periodically</strong></p><p>As you delegate more and more to AI, the problem is that you are operating at a higher level of abstraction without staying in touch with the layers underneath. So go back down periodically. Open the code. Inspect the data. Make sure you understand what&#8217;s going on. A quick Slop Cliff check: can you explain where your data came from and how you got your results without asking the model?</p><p><strong>Showing people your work</strong></p><p>In AA, one of the first things newcomers are encouraged to do is find a sponsor: someone further along in recovery who they check in with regularly and who can tell when they&#8217;re starting to slip (and people who have one <a href="https://www.recoveryanswers.org/research-post/benefits-of-the-therapeutic-alliance-between-sponsor-sponsee-in-12-step-groups">tend to stay sober more often</a>).</p><p>I think the closest thing slopaholics have to a sponsor is other people looking at their work. In the story above, the spell broke as soon as a friend asked which dataset you used. Explaining your work forces you to face all the parts of the work you don&#8217;t understand. So find a sponsor of your own: a friend/collaborator/supervisor who will go through your code and results with you and ask annoying questions, to help you see where your understanding is shoddy.</p><h2>The Wisdom of xkcd</h2><p><a href="https://xkcd.com/323/">Randall Munroe&#8217;s original comic</a> already contains the warning:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!j9WS!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1ec50881-f14a-4f32-b612-80d165e62492_924x1032.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!j9WS!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1ec50881-f14a-4f32-b612-80d165e62492_924x1032.png 424w, https://substackcdn.com/image/fetch/$s_!j9WS!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1ec50881-f14a-4f32-b612-80d165e62492_924x1032.png 848w, https://substackcdn.com/image/fetch/$s_!j9WS!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1ec50881-f14a-4f32-b612-80d165e62492_924x1032.png 1272w, https://substackcdn.com/image/fetch/$s_!j9WS!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1ec50881-f14a-4f32-b612-80d165e62492_924x1032.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!j9WS!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1ec50881-f14a-4f32-b612-80d165e62492_924x1032.png" width="462" height="516" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/1ec50881-f14a-4f32-b612-80d165e62492_924x1032.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1032,&quot;width&quot;:924,&quot;resizeWidth&quot;:462,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Panel from xkcd's Ballmer Peak comic warning that the effect requires careful calibration.&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Panel from xkcd's Ballmer Peak comic warning that the effect requires careful calibration." title="Panel from xkcd's Ballmer Peak comic warning that the effect requires careful calibration." srcset="https://substackcdn.com/image/fetch/$s_!j9WS!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1ec50881-f14a-4f32-b612-80d165e62492_924x1032.png 424w, https://substackcdn.com/image/fetch/$s_!j9WS!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1ec50881-f14a-4f32-b612-80d165e62492_924x1032.png 848w, https://substackcdn.com/image/fetch/$s_!j9WS!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1ec50881-f14a-4f32-b612-80d165e62492_924x1032.png 1272w, https://substackcdn.com/image/fetch/$s_!j9WS!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1ec50881-f14a-4f32-b612-80d165e62492_924x1032.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Similarly, you can&#8217;t give a team of coders unlimited tokens and assume that will make them infinitely more productive. You still have to make sure that they&#8217;re using the tokens well.</p><p>The same goes for your own token use. Aiming for Karpathy Peak is fine. Just check your work often enough to notice when you&#8217;ve gone past it.</p><p><em>If you enjoyed this post, follow me on <a href="https://x.com/tomjiralerspong">X/Twitter</a> for more thoughts on AI and AI research! (and consider <a href="https://x.com/tomjiralerspong/status/2115211712085533112?a=BiWwfTcbhrfL0Vk99aA&amp;s=20">reposting the tweet for this post</a> so I can reach more people)</em></p><p><em>You can also find my AI safety/mechanistic interpretability research on my <a href="https://thomas.jiralerspong.com/">website</a> and <a href="https://scholar.google.com/citations?user=ifQsJnIAAAAJ&amp;hl=en">Google Scholar</a>.</em></p><p><em>Full disclosure: I used AI to help write this post. I&#8217;ll let you be the judge of whether I was able to stay away from Slop Cliff.</em></p><p><em>Thank you to Stepan Shabalin, Parv Mahajan, Tim Hua, Stephen Lu, Celeste Li, McNair Shah, Jasmine Li, and Mukesh Ramanathan for their feedback on the post.</em></p>]]></content:encoded></item><item><title><![CDATA[Persona Vectors don’t work on real data]]></title><description><![CDATA[Or: Why you should stop overusing synthetic data for your research.]]></description><link>https://blog.thomas.jiralerspong.com/p/persona-vectors-dont-work-on-real</link><guid isPermaLink="false">https://blog.thomas.jiralerspong.com/p/persona-vectors-dont-work-on-real</guid><dc:creator><![CDATA[Thomas Jiralerspong]]></dc:creator><pubDate>Tue, 27 Oct 2026 17:39:00 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!dcJq!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1697bbe4-0e57-4e7e-9e4d-4ac29391181c_1372x564.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><strong>TL;DR:</strong></p><ul><li><p>Stop defaulting to LLM-generated synthetic data for your evals. Your eval should come from the distribution your claim is actually about.</p></li><li><p>I tried to reproduce the Persona Vectors result where projecting a prompt&#8217;s final-token activation onto a persona vector predicts how much the response will express the trait. It reproduces on the paper&#8217;s own eval prompts and drops to roughly zero on real chat data (WildChat).</p></li><li><p>The eval prompts were LLM-generated and explicitly tell the model to be (or not be) evil, sycophantic, or hallucinatory, and the vectors were extracted on nearly identical prompts. An LLM judge could probably predict the trait score from the prompt just as well.</p></li><li><p>Real data is almost always available. Existing real-data benchmarks cover more traits than you&#8217;d expect, and when they don&#8217;t, filtering a real corpus (WildChat, LMSYS, Reddit) with an LLM judge works better than generating prompts, since LLMs are bad at realism.</p></li><li><p>If there is no real data at all, that is itself a signal about the project. If you still go synthetic, use the synthetic-data literature, report which model generated what, and don&#8217;t expect the result to transfer.</p></li><li><p>We recommend researchers create a skill file for their coding agents to avoid making these same mistakes.</p></li></ul><p><em>Disclaimer: I am using the Persona Vectors paper as a concrete example here because it&#8217;s a recent, popular paper (290 citations in 1 year). I don&#8217;t have any particular problem with this paper specifically. I just wanted to use it as a representative example of something I find to be pretty widespread in AI (and probably also non-AI) research these days.</em></p><p>I recently was trying to reproduce a result from &#8220;<a href="https://arxiv.org/abs/2507.21509">Persona Vectors: Monitoring and Controlling Character Traits in Language Models</a>&#8221; to use as a baseline.</p><p>The result in question is super cool: projecting the model&#8217;s final prompt-token activation onto a persona vector can be used to predict how much the prompt will make the model express a particular trait (sycophancy, hallucination, evil), which they say can be used to &#8220;monitor prompt-induced behavioral shifts&#8221;. The result is in <a href="https://arxiv.org/html/2507.21509v3#S3.SS3">Section 3.3</a>.</p><p>Naturally, being a somewhat lazy vibecoder, I told Claude &#8220;reproduce the predict from context vector experiment from the persona vectors paper and compare to our method&#8221;. The result:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!dcJq!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1697bbe4-0e57-4e7e-9e4d-4ac29391181c_1372x564.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!dcJq!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1697bbe4-0e57-4e7e-9e4d-4ac29391181c_1372x564.png 424w, https://substackcdn.com/image/fetch/$s_!dcJq!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1697bbe4-0e57-4e7e-9e4d-4ac29391181c_1372x564.png 848w, https://substackcdn.com/image/fetch/$s_!dcJq!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1697bbe4-0e57-4e7e-9e4d-4ac29391181c_1372x564.png 1272w, https://substackcdn.com/image/fetch/$s_!dcJq!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1697bbe4-0e57-4e7e-9e4d-4ac29391181c_1372x564.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!dcJq!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1697bbe4-0e57-4e7e-9e4d-4ac29391181c_1372x564.png" width="1372" height="564" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/1697bbe4-0e57-4e7e-9e4d-4ac29391181c_1372x564.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:564,&quot;width&quot;:1372,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Bar chart comparing persona-vector and alternative-method correlations for evil, sycophancy, and hallucination on synthetic prompts.&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Bar chart comparing persona-vector and alternative-method correlations for evil, sycophancy, and hallucination on synthetic prompts." title="Bar chart comparing persona-vector and alternative-method correlations for evil, sycophancy, and hallucination on synthetic prompts." srcset="https://substackcdn.com/image/fetch/$s_!dcJq!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1697bbe4-0e57-4e7e-9e4d-4ac29391181c_1372x564.png 424w, https://substackcdn.com/image/fetch/$s_!dcJq!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1697bbe4-0e57-4e7e-9e4d-4ac29391181c_1372x564.png 848w, https://substackcdn.com/image/fetch/$s_!dcJq!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1697bbe4-0e57-4e7e-9e4d-4ac29391181c_1372x564.png 1272w, https://substackcdn.com/image/fetch/$s_!dcJq!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1697bbe4-0e57-4e7e-9e4d-4ac29391181c_1372x564.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><em>On the paper&#8217;s own evaluation prompts, the persona vector predicts trait expression about as well as the method I was benchmarking against it.</em></p><p>This unfortunately seemed to indicate that my method was not useful for this particular task, and that persona vectors were already doing well.</p><p>So then I decided to go look more closely at the actual experiment, in particular the evaluation prompts used for it:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!XA_b!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1ca2466-ab04-452a-a2e0-8700a11ac250_1100x626.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!XA_b!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1ca2466-ab04-452a-a2e0-8700a11ac250_1100x626.png 424w, https://substackcdn.com/image/fetch/$s_!XA_b!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1ca2466-ab04-452a-a2e0-8700a11ac250_1100x626.png 848w, https://substackcdn.com/image/fetch/$s_!XA_b!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1ca2466-ab04-452a-a2e0-8700a11ac250_1100x626.png 1272w, https://substackcdn.com/image/fetch/$s_!XA_b!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1ca2466-ab04-452a-a2e0-8700a11ac250_1100x626.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!XA_b!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1ca2466-ab04-452a-a2e0-8700a11ac250_1100x626.png" width="1100" height="626" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/f1ca2466-ab04-452a-a2e0-8700a11ac250_1100x626.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:626,&quot;width&quot;:1100,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Evaluation system prompts explicitly encouraging or discouraging evil behavior.&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Evaluation system prompts explicitly encouraging or discouraging evil behavior." title="Evaluation system prompts explicitly encouraging or discouraging evil behavior." srcset="https://substackcdn.com/image/fetch/$s_!XA_b!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1ca2466-ab04-452a-a2e0-8700a11ac250_1100x626.png 424w, https://substackcdn.com/image/fetch/$s_!XA_b!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1ca2466-ab04-452a-a2e0-8700a11ac250_1100x626.png 848w, https://substackcdn.com/image/fetch/$s_!XA_b!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1ca2466-ab04-452a-a2e0-8700a11ac250_1100x626.png 1272w, https://substackcdn.com/image/fetch/$s_!XA_b!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1ca2466-ab04-452a-a2e0-8700a11ac250_1100x626.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!ylcq!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7107aa7c-93d4-4d99-96f5-0312ee57fe83_1106x760.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!ylcq!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7107aa7c-93d4-4d99-96f5-0312ee57fe83_1106x760.png 424w, https://substackcdn.com/image/fetch/$s_!ylcq!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7107aa7c-93d4-4d99-96f5-0312ee57fe83_1106x760.png 848w, https://substackcdn.com/image/fetch/$s_!ylcq!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7107aa7c-93d4-4d99-96f5-0312ee57fe83_1106x760.png 1272w, https://substackcdn.com/image/fetch/$s_!ylcq!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7107aa7c-93d4-4d99-96f5-0312ee57fe83_1106x760.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!ylcq!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7107aa7c-93d4-4d99-96f5-0312ee57fe83_1106x760.png" width="1106" height="760" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/7107aa7c-93d4-4d99-96f5-0312ee57fe83_1106x760.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:760,&quot;width&quot;:1106,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Evaluation system prompts explicitly encouraging or discouraging sycophancy.&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Evaluation system prompts explicitly encouraging or discouraging sycophancy." title="Evaluation system prompts explicitly encouraging or discouraging sycophancy." srcset="https://substackcdn.com/image/fetch/$s_!ylcq!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7107aa7c-93d4-4d99-96f5-0312ee57fe83_1106x760.png 424w, https://substackcdn.com/image/fetch/$s_!ylcq!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7107aa7c-93d4-4d99-96f5-0312ee57fe83_1106x760.png 848w, https://substackcdn.com/image/fetch/$s_!ylcq!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7107aa7c-93d4-4d99-96f5-0312ee57fe83_1106x760.png 1272w, https://substackcdn.com/image/fetch/$s_!ylcq!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7107aa7c-93d4-4d99-96f5-0312ee57fe83_1106x760.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><em>The evaluation prompts for evil and sycophancy. Each set is an eight-step ladder from &#8220;be the trait&#8221; to &#8220;don&#8217;t be the trait&#8221;.</em></p><p>There are a few problems with this:</p><ul><li><p>The prompts all contain explicit encouragements to exhibit or not exhibit the behavior.</p></li><li><p>The persona vectors were extracted as mass-mean probes on almost identical prompts.</p></li></ul><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!iyRv!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F193abc45-e429-4403-921f-aaeb7ea9b9de_1104x344.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!iyRv!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F193abc45-e429-4403-921f-aaeb7ea9b9de_1104x344.png 424w, https://substackcdn.com/image/fetch/$s_!iyRv!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F193abc45-e429-4403-921f-aaeb7ea9b9de_1104x344.png 848w, https://substackcdn.com/image/fetch/$s_!iyRv!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F193abc45-e429-4403-921f-aaeb7ea9b9de_1104x344.png 1272w, https://substackcdn.com/image/fetch/$s_!iyRv!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F193abc45-e429-4403-921f-aaeb7ea9b9de_1104x344.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!iyRv!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F193abc45-e429-4403-921f-aaeb7ea9b9de_1104x344.png" width="1104" height="344" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/193abc45-e429-4403-921f-aaeb7ea9b9de_1104x344.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:344,&quot;width&quot;:1104,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Positive extraction instructions encouraging evil behavior.&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Positive extraction instructions encouraging evil behavior." title="Positive extraction instructions encouraging evil behavior." srcset="https://substackcdn.com/image/fetch/$s_!iyRv!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F193abc45-e429-4403-921f-aaeb7ea9b9de_1104x344.png 424w, https://substackcdn.com/image/fetch/$s_!iyRv!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F193abc45-e429-4403-921f-aaeb7ea9b9de_1104x344.png 848w, https://substackcdn.com/image/fetch/$s_!iyRv!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F193abc45-e429-4403-921f-aaeb7ea9b9de_1104x344.png 1272w, https://substackcdn.com/image/fetch/$s_!iyRv!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F193abc45-e429-4403-921f-aaeb7ea9b9de_1104x344.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Ddtr!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd8bbaa8f-90f6-421e-a522-6c607a1a35d5_1098x380.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Ddtr!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd8bbaa8f-90f6-421e-a522-6c607a1a35d5_1098x380.png 424w, https://substackcdn.com/image/fetch/$s_!Ddtr!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd8bbaa8f-90f6-421e-a522-6c607a1a35d5_1098x380.png 848w, https://substackcdn.com/image/fetch/$s_!Ddtr!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd8bbaa8f-90f6-421e-a522-6c607a1a35d5_1098x380.png 1272w, https://substackcdn.com/image/fetch/$s_!Ddtr!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd8bbaa8f-90f6-421e-a522-6c607a1a35d5_1098x380.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!Ddtr!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd8bbaa8f-90f6-421e-a522-6c607a1a35d5_1098x380.png" width="1098" height="380" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d8bbaa8f-90f6-421e-a522-6c607a1a35d5_1098x380.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:380,&quot;width&quot;:1098,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Negative extraction instructions discouraging evil behavior.&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Negative extraction instructions discouraging evil behavior." title="Negative extraction instructions discouraging evil behavior." srcset="https://substackcdn.com/image/fetch/$s_!Ddtr!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd8bbaa8f-90f6-421e-a522-6c607a1a35d5_1098x380.png 424w, https://substackcdn.com/image/fetch/$s_!Ddtr!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd8bbaa8f-90f6-421e-a522-6c607a1a35d5_1098x380.png 848w, https://substackcdn.com/image/fetch/$s_!Ddtr!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd8bbaa8f-90f6-421e-a522-6c607a1a35d5_1098x380.png 1272w, https://substackcdn.com/image/fetch/$s_!Ddtr!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd8bbaa8f-90f6-421e-a522-6c607a1a35d5_1098x380.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><em>The instructions used to extract the evil persona vector. Compare them against the evaluation prompts above.</em></p><p>So it&#8217;s not particularly surprising that projecting the vector onto the context can predict behavior in this case. An LLM judge (or any human) probably could have predicted the expression just as well.</p><p>Now I fully get why they did this: it gives you a nice wide spread of trait expression data. But this is not really the kind of prompt we would want to apply this method to at deployment time. We would want to know if a prompt might induce these traits in non-obvious ways.</p><h2>Running the same eval on real data</h2><p>So then I tried running their same eval on real data (WildChat) and found:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!-NIq!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9adcbac5-f676-43a2-9d5a-8cafd9cba5da_2530x1056.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!-NIq!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9adcbac5-f676-43a2-9d5a-8cafd9cba5da_2530x1056.png 424w, https://substackcdn.com/image/fetch/$s_!-NIq!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9adcbac5-f676-43a2-9d5a-8cafd9cba5da_2530x1056.png 848w, https://substackcdn.com/image/fetch/$s_!-NIq!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9adcbac5-f676-43a2-9d5a-8cafd9cba5da_2530x1056.png 1272w, https://substackcdn.com/image/fetch/$s_!-NIq!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9adcbac5-f676-43a2-9d5a-8cafd9cba5da_2530x1056.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!-NIq!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9adcbac5-f676-43a2-9d5a-8cafd9cba5da_2530x1056.png" width="1456" height="608" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/9adcbac5-f676-43a2-9d5a-8cafd9cba5da_2530x1056.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:608,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Bar chart showing lower correlations for both methods on WildChat, with persona-vector correlations near zero.&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Bar chart showing lower correlations for both methods on WildChat, with persona-vector correlations near zero." title="Bar chart showing lower correlations for both methods on WildChat, with persona-vector correlations near zero." srcset="https://substackcdn.com/image/fetch/$s_!-NIq!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9adcbac5-f676-43a2-9d5a-8cafd9cba5da_2530x1056.png 424w, https://substackcdn.com/image/fetch/$s_!-NIq!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9adcbac5-f676-43a2-9d5a-8cafd9cba5da_2530x1056.png 848w, https://substackcdn.com/image/fetch/$s_!-NIq!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9adcbac5-f676-43a2-9d5a-8cafd9cba5da_2530x1056.png 1272w, https://substackcdn.com/image/fetch/$s_!-NIq!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9adcbac5-f676-43a2-9d5a-8cafd9cba5da_2530x1056.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><em>The same experiment on real user prompts. The persona-vector correlations collapse to roughly zero, and two of the three go negative.</em></p><p>Persona vectors don&#8217;t generalize at all! And my method also does a lot worse. Again, the goal of this is not to attack the Persona Vectors paper. I just wanted to show an example (among many) of the overuse of synthetic data and its consequences.</p><h2>&#8220;But natural prompts never elicit evil&#8221;</h2><p>Now one problem with this is that since models are trained to avoid these behaviors, natural prompts might rarely elicit them. To see this, we can plot the behavior expression distributions:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!IAaF!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F56c9bdee-54ee-457e-8881-d86a91acfbb7_1360x752.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!IAaF!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F56c9bdee-54ee-457e-8881-d86a91acfbb7_1360x752.png 424w, https://substackcdn.com/image/fetch/$s_!IAaF!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F56c9bdee-54ee-457e-8881-d86a91acfbb7_1360x752.png 848w, https://substackcdn.com/image/fetch/$s_!IAaF!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F56c9bdee-54ee-457e-8881-d86a91acfbb7_1360x752.png 1272w, https://substackcdn.com/image/fetch/$s_!IAaF!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F56c9bdee-54ee-457e-8881-d86a91acfbb7_1360x752.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!IAaF!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F56c9bdee-54ee-457e-8881-d86a91acfbb7_1360x752.png" width="1360" height="752" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/56c9bdee-54ee-457e-8881-d86a91acfbb7_1360x752.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:752,&quot;width&quot;:1360,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Histogram of mean sycophancy scores on WildChat, concentrated toward lower scores.&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Histogram of mean sycophancy scores on WildChat, concentrated toward lower scores." title="Histogram of mean sycophancy scores on WildChat, concentrated toward lower scores." srcset="https://substackcdn.com/image/fetch/$s_!IAaF!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F56c9bdee-54ee-457e-8881-d86a91acfbb7_1360x752.png 424w, https://substackcdn.com/image/fetch/$s_!IAaF!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F56c9bdee-54ee-457e-8881-d86a91acfbb7_1360x752.png 848w, https://substackcdn.com/image/fetch/$s_!IAaF!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F56c9bdee-54ee-457e-8881-d86a91acfbb7_1360x752.png 1272w, https://substackcdn.com/image/fetch/$s_!IAaF!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F56c9bdee-54ee-457e-8881-d86a91acfbb7_1360x752.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!YhxJ!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2c74eac-61eb-4963-90f4-036da93090fc_1364x760.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!YhxJ!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2c74eac-61eb-4963-90f4-036da93090fc_1364x760.png 424w, https://substackcdn.com/image/fetch/$s_!YhxJ!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2c74eac-61eb-4963-90f4-036da93090fc_1364x760.png 848w, https://substackcdn.com/image/fetch/$s_!YhxJ!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2c74eac-61eb-4963-90f4-036da93090fc_1364x760.png 1272w, https://substackcdn.com/image/fetch/$s_!YhxJ!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2c74eac-61eb-4963-90f4-036da93090fc_1364x760.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!YhxJ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2c74eac-61eb-4963-90f4-036da93090fc_1364x760.png" width="1364" height="760" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/e2c74eac-61eb-4963-90f4-036da93090fc_1364x760.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:760,&quot;width&quot;:1364,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Histogram of mean hallucination scores on WildChat.&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Histogram of mean hallucination scores on WildChat." title="Histogram of mean hallucination scores on WildChat." srcset="https://substackcdn.com/image/fetch/$s_!YhxJ!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2c74eac-61eb-4963-90f4-036da93090fc_1364x760.png 424w, https://substackcdn.com/image/fetch/$s_!YhxJ!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2c74eac-61eb-4963-90f4-036da93090fc_1364x760.png 848w, https://substackcdn.com/image/fetch/$s_!YhxJ!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2c74eac-61eb-4963-90f4-036da93090fc_1364x760.png 1272w, https://substackcdn.com/image/fetch/$s_!YhxJ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2c74eac-61eb-4963-90f4-036da93090fc_1364x760.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!U6Z2!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7176fc2a-8163-4b01-bbf5-1dcccbecabe9_1376x768.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!U6Z2!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7176fc2a-8163-4b01-bbf5-1dcccbecabe9_1376x768.png 424w, https://substackcdn.com/image/fetch/$s_!U6Z2!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7176fc2a-8163-4b01-bbf5-1dcccbecabe9_1376x768.png 848w, https://substackcdn.com/image/fetch/$s_!U6Z2!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7176fc2a-8163-4b01-bbf5-1dcccbecabe9_1376x768.png 1272w, https://substackcdn.com/image/fetch/$s_!U6Z2!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7176fc2a-8163-4b01-bbf5-1dcccbecabe9_1376x768.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!U6Z2!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7176fc2a-8163-4b01-bbf5-1dcccbecabe9_1376x768.png" width="1376" height="768" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/7176fc2a-8163-4b01-bbf5-1dcccbecabe9_1376x768.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:768,&quot;width&quot;:1376,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Histogram of mean evil scores on WildChat, concentrated near zero.&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Histogram of mean evil scores on WildChat, concentrated near zero." title="Histogram of mean evil scores on WildChat, concentrated near zero." srcset="https://substackcdn.com/image/fetch/$s_!U6Z2!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7176fc2a-8163-4b01-bbf5-1dcccbecabe9_1376x768.png 424w, https://substackcdn.com/image/fetch/$s_!U6Z2!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7176fc2a-8163-4b01-bbf5-1dcccbecabe9_1376x768.png 848w, https://substackcdn.com/image/fetch/$s_!U6Z2!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7176fc2a-8163-4b01-bbf5-1dcccbecabe9_1376x768.png 1272w, https://substackcdn.com/image/fetch/$s_!U6Z2!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7176fc2a-8163-4b01-bbf5-1dcccbecabe9_1376x768.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><em>Trait expression on WildChat. Sycophancy and hallucination have usable spread; evil is almost never elicited.</em></p><p>We see that evil is very rarely elicited by natural prompts. So then is it time to make a synthetic eval? No! The next recourse should be to try to find existing benchmarks related to what we want to measure.</p><p>In this case, we want to measure evil, sycophancy, and hallucination. For example:</p><p><strong>Sycophancy</strong>: <a href="https://arxiv.org/abs/2505.13995">ELEPHANT</a> (Cheng et al. 2025): 3,027 real open-ended personal-advice questions collected in earlier human studies, plus 2,000 real r/AmITheAsshole posts with the community verdict.</p><p><strong>Hallucination</strong>: <a href="https://arxiv.org/abs/1705.03551">TriviaQA</a> (Joshi et al. 2017): 95K questions written by trivia enthusiasts.</p><p><strong>Evil / harmful compliance</strong>: <a href="https://arxiv.org/abs/2310.17389">ToxicChat</a> (Lin et al. 2023): 10,166 real user queries from a Vicuna demo, human-annotated.</p><p>There is still not too much evil expression but it is at least enough to see if your method works:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!9voc!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb9ed0e86-87f8-442f-b98e-f495056bde2b_1390x766.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!9voc!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb9ed0e86-87f8-442f-b98e-f495056bde2b_1390x766.png 424w, https://substackcdn.com/image/fetch/$s_!9voc!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb9ed0e86-87f8-442f-b98e-f495056bde2b_1390x766.png 848w, https://substackcdn.com/image/fetch/$s_!9voc!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb9ed0e86-87f8-442f-b98e-f495056bde2b_1390x766.png 1272w, https://substackcdn.com/image/fetch/$s_!9voc!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb9ed0e86-87f8-442f-b98e-f495056bde2b_1390x766.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!9voc!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb9ed0e86-87f8-442f-b98e-f495056bde2b_1390x766.png" width="1390" height="766" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b9ed0e86-87f8-442f-b98e-f495056bde2b_1390x766.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:766,&quot;width&quot;:1390,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Histogram of mean evil scores on flagged ToxicChat prompts, with some nonzero expression.&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Histogram of mean evil scores on flagged ToxicChat prompts, with some nonzero expression." title="Histogram of mean evil scores on flagged ToxicChat prompts, with some nonzero expression." srcset="https://substackcdn.com/image/fetch/$s_!9voc!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb9ed0e86-87f8-442f-b98e-f495056bde2b_1390x766.png 424w, https://substackcdn.com/image/fetch/$s_!9voc!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb9ed0e86-87f8-442f-b98e-f495056bde2b_1390x766.png 848w, https://substackcdn.com/image/fetch/$s_!9voc!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb9ed0e86-87f8-442f-b98e-f495056bde2b_1390x766.png 1272w, https://substackcdn.com/image/fetch/$s_!9voc!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb9ed0e86-87f8-442f-b98e-f495056bde2b_1390x766.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><em>Evil scores on flagged ToxicChat prompts &#8212; still concentrated at the bottom, but no longer empty above it.</em></p><h2>What if no one has benchmarked your trait?</h2><p>But let&#8217;s say we were trying to measure something obscure that no one has made a benchmark for (e.g. the &#8220;apathetic&#8221; trait from the Persona Vectors paper). Now you&#8217;re forced to make a synthetic eval, right?</p><p>Wrong!</p><p>Let&#8217;s think. You want your eval to (a) be realistic and (b) elicit the specific trait.</p><p>One way to do this is to get an LLM to generate prompts that elicit the trait and ask it to &#8220;make them realistic&#8221; (although people often forget even this). Unfortunately, realism is very hard, and LLMs are really bad at it:</p><ul><li><p>Assistant-trained models make poor user simulators, and the better the assistant, the worse the simulator (<a href="https://arxiv.org/abs/2510.06552">Naous et al. 2025</a>).</p></li><li><p>LLM &#8220;silicon samples&#8221; of humans have far less variance than real people and flatten the groups they are meant to represent (<a href="https://www.cambridge.org/core/journals/political-analysis/article/synthetic-replacements-for-human-survey-data-the-perils-of-large-language-models/B92267DC26195C7F36E63EA04A47D2FE">Bisbee et al. 2024</a>, <a href="https://arxiv.org/abs/2402.01908">Wang et al. 2025</a>).</p></li><li><p>LLM outputs on open-ended prompts are homogeneous within a model and across models (<a href="https://arxiv.org/abs/2510.22954">Jiang et al. 2025</a>).</p></li><li><p><a href="https://www.lesswrong.com/posts/jdoDvKGLbaaJWnDpE/tools-to-generate-realistic-prompts-help-surprisingly-little">Kissane et al. 2026</a> trained a prompt generator to be indistinguishable from WildChat and found it helped surprisingly little with making full audit transcripts realistic.</p></li></ul><p>The better way, since realism is hard, is to start from real prompts and filter:</p><ol><li><p>Get a large corpus of real user prompts: <a href="https://arxiv.org/abs/2405.01470">WildChat</a>, <a href="https://arxiv.org/abs/2309.11998">LMSYS-Chat-1M</a>, Reddit, the HH-RLHF red-team transcripts, or whatever matches your deployment setting.</p></li><li><p>Run an LLM judge over it to find the prompts relevant to your trait. Read a sample by hand to check the judge.</p></li><li><p>If you need scale, train a cheap classifier on text embeddings using the judge labels and run it over the rest of the corpus.</p></li></ol><p>This is often how these realistic benchmarks are made: <a href="https://arxiv.org/abs/2406.04770">WildBench</a> filters 1,024 hard tasks out of a million WildChat logs, <a href="https://arxiv.org/abs/2406.11939">Arena-Hard</a> filters Chatbot Arena prompts into a benchmark, and <a href="https://arxiv.org/abs/2406.18510">WildJailbreak</a> mines jailbreak tactics from real LMSYS and WildChat conversations.</p><h2>What if there is really no real data?</h2><p>Now let&#8217;s say that your eval is so specific that you can&#8217;t find any real data. Then okay, maybe you should make a synthetic eval. But you should still try to make sure your eval matches your claim distribution as much as possible. Four things:</p><ul><li><p>If you really can&#8217;t find ANY real data related to your claim, maybe it&#8217;s doubtful that the project is useful in the real world?</p></li><li><p>There is an entire literature on the science and art of synthetic evals which you can draw upon: <a href="https://arxiv.org/abs/2404.07503">Best Practices and Lessons Learned on Synthetic Data</a> (Liu et al. 2024), the <a href="https://arxiv.org/abs/2406.15126">Long et al. 2024 survey</a> of LLM-driven data generation, <a href="https://arxiv.org/abs/2411.12990">BetterBench</a> (Reuel et al. 2024), and <a href="https://arxiv.org/abs/2511.04703">Bean et al. 2025</a> on construct validity in LLM benchmarks. Perez et al.&#8217;s original <a href="https://arxiv.org/abs/2212.09251">model-written evals paper</a> is also more careful about validating the generated data than most of the work that cites it.</p></li><li><p>Even despite that, I would still hesitate to trust any claim made on synthetic data to transfer to real-world scenarios. LLMs can tell their own text from human text at above-chance rates and prefer it (<a href="https://arxiv.org/abs/2404.13076">Panickssery et al. 2024</a>, though how reliably is contested, see <a href="https://arxiv.org/abs/2510.03399">Bai et al. 2025</a>). Their outputs are mode-collapsed towards a typical style (<a href="https://arxiv.org/abs/2510.01171">Zhang et al. 2025</a>, <a href="https://arxiv.org/abs/2406.05587">Mohammadi 2024</a>).</p></li><li><p>Depending on the scale of your experiments, we still have the ability to write things ourselves. This is also not particularly mentally intensive work (depending on what kind of data), so you can preserve your deep-work hours (forthcoming work) and just do it during shallow work (or make a data collection party with your friends!).</p></li></ul><h2>The same thing outside AI</h2><p>My post is about AI research because that&#8217;s what I have experience with, but having talked to my friend doing a PhD in psychology, it seems like the social sciences are plagued with a similar problem. It&#8217;s even worse there, because a bad experimental design can cost months of time and hundreds of thousands of dollars instead of a single Claude Code prompt and one day.</p><h2>Concrete recommendations</h2><ol><li><p>Write down the distribution your claim is about before you write the eval. &#8220;Persona vectors can monitor prompt-induced shifts&#8221; is a claim about prompts users actually send, so the eval needs to contain prompts users actually send.</p></li><li><p>Check whether your eval prompts and your method&#8217;s training or extraction prompts came from the same generator with the same template. If they did, &#8220;held-out&#8221; mostly means &#8220;held-out from the same distribution&#8221;.</p></li><li><p>Before generating anything, spend half an hour (or one deep-research query) looking for an existing benchmark built from real data. There are more of them than you&#8217;d expect.</p></li><li><p>If there is no benchmark, filter a real corpus instead of generating one.</p></li><li><p>If you do go synthetic: condition the generator on real examples, ask for realism explicitly, use more than one generator model, have a human compare a sample against real data.</p></li></ol><h2>Why this happens</h2><p>Writing &#8220;generate diverse questions to evaluate the level of X&#8221; is much easier than going through all the hassle above.</p><p>In the past, people had to painstakingly either make entire datasets themselves or pay data collection services to do it:</p><ul><li><p>TruthfulQA&#8217;s 817 questions were written by the authors by hand.</p></li><li><p>MMLU&#8217;s 15,908 questions were collected one by one by students.</p></li><li><p>ImageNet&#8217;s 14 million images were labeled by roughly 49,000 MTurk workers.</p></li></ul><p>Just because LLMs have made this process easier doesn&#8217;t mean we have to be fully lazy. So be grateful for not having to do this, but at least put in the small amount of effort to make sure that you use LLMs to make the best eval possible.</p><p>Luckily, you can just tell your LLMs to follow all of this advice by creating a skill file!</p>]]></content:encoded></item><item><title><![CDATA[The Art of AI Art]]></title><description><![CDATA[On creative vision, creative execution, and the art I haven&#8217;t made yet.]]></description><link>https://blog.thomas.jiralerspong.com/p/the-art-of-ai-art</link><guid isPermaLink="false">https://blog.thomas.jiralerspong.com/p/the-art-of-ai-art</guid><dc:creator><![CDATA[Thomas Jiralerspong]]></dc:creator><pubDate>Tue, 29 Sep 2026 02:12:13 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!KIh_!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2b60ff62-429b-41c3-9de6-d6d88dba1d44_1672x941.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!KIh_!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2b60ff62-429b-41c3-9de6-d6d88dba1d44_1672x941.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!KIh_!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2b60ff62-429b-41c3-9de6-d6d88dba1d44_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!KIh_!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2b60ff62-429b-41c3-9de6-d6d88dba1d44_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!KIh_!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2b60ff62-429b-41c3-9de6-d6d88dba1d44_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!KIh_!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2b60ff62-429b-41c3-9de6-d6d88dba1d44_1672x941.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!KIh_!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2b60ff62-429b-41c3-9de6-d6d88dba1d44_1672x941.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/2b60ff62-429b-41c3-9de6-d6d88dba1d44_1672x941.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;A musician and a robot collaborate in a home studio as sketches become imagined scenes of music, film, and a game world.&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="A musician and a robot collaborate in a home studio as sketches become imagined scenes of music, film, and a game world." title="A musician and a robot collaborate in a home studio as sketches become imagined scenes of music, film, and a game world." srcset="https://substackcdn.com/image/fetch/$s_!KIh_!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2b60ff62-429b-41c3-9de6-d6d88dba1d44_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!KIh_!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2b60ff62-429b-41c3-9de6-d6d88dba1d44_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!KIh_!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2b60ff62-429b-41c3-9de6-d6d88dba1d44_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!KIh_!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2b60ff62-429b-41c3-9de6-d6d88dba1d44_1672x941.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>When I was young, I wanted to be either a screenwriter, a musician, or a videogame designer. So, obviously I decided to study computer science and have a Letterboxd and sing karaoke on the side. I haven&#8217;t given up my artistic aspirations, though. I still dream of one day releasing an album, a movie, or an indie video game. Even now, working as an AI researcher, I think most of my joy comes from the act of doing something that&#8217;s never been done before. Unfortunately, my <a href="https://soundcloud.com/jirato/time">forays into music production</a> have shown me that producing a song that actually sounds professional takes a lot of time and expertise, neither of which I have enough of right now.</p><p>The equipment is less of a barrier than it used to be. Billie Eilish and Finneas famously recorded her debut album in <a href="https://www.soundonsound.com/people/billie-eilish">his bedroom</a>. But even they hired an experienced <a href="https://www.waves.com/breaking-the-mix-rules-with-billie-eilish-rob-kinelski">mix engineer</a>. And Finneas had already spent years learning his craft, having <a href="https://www.soundonsound.com/people/billie-eilish">started recording and producing music at 13</a>.</p><p>And so I&#8217;ve shelved my artistic dreams for now, telling myself I&#8217;ll get to them later. I think this is the third year that my New Year&#8217;s resolution has been to produce a professional sounding song. Every year, my list of ideas for songs, movies, and videogames gets longer.</p><p>I still have a sense of what I want these things to look and sound like. If only I had a producer who could sit down with me and help bring them to life. I suspect a lot of people feel some version of this. Who hasn&#8217;t imagined another story in their favorite fictional universe, or a game they wish existed? Having the idea is easy. Finding the time, money, and expertise to make it is much harder.</p><p>Which brings me to AI art.</p><p>Until recently, I was against it. But then I started looking into what people were making, and I was pretty impressed.</p><p>There&#8217;s <a href="https://suno.com/">Suno</a> for music (see examples on the website). In film, some recent ones:</p><ul><li><p><a href="https://higgsfield.ai/contests/make-your-action-scene/submissions/4132edf8-f419-4e26-92c3-b2ce344b9592">Grandma vs Wasp</a> turns a grandmother&#8217;s breakfast into an escalating battle with a wasp.</p></li><li><p><a href="https://higgsfield.ai/contests/make-your-action-scene/submissions/e142c884-79cc-42ba-961f-04e03ef6f5ab">Scratch</a> follows two crash-test dummies trying to escape the people who made them.</p></li><li><p><a href="https://andrewtsalter.com/jailbird">Jailbird</a> tells the story of a chicken sent to a human prison, from the chicken&#8217;s perspective.</p></li><li><p>Jacob Adler&#8217;s <a href="https://www.youtube.com/watch?v=zpAeygE4d1A">Total Pixel Space</a> explores the idea of every possible digital image, including every life you could have lived.</p></li></ul><p>For longer fiction, Brad Feld has been publishing <a href="https://feld.com/archives/2026/07/zero-knowledge-twenty-chapters-in/">Zero Knowledge</a> chapter by chapter in 2026, using an AI collaborator to draft from his outline before substantially rewriting the results.</p><p>I&#8217;m not saying we&#8217;re all the way there yet. There&#8217;s still something unsettling about a lot of these songs and movies. But I remember what the outputs looked like a few years ago. Extrapolating from that progress, it seems plausible to me that many of the remaining technical limitations will become less important very soon.</p><p>Would that be good? Should we want art to remain a firmly human endeavor, even if we could somehow get everyone to agree to that?</p><p>I think it helps to distinguish two parts of creating art: <strong>creative vision</strong>, knowing what you want to create, and <strong>creative execution</strong>, having the skills and tools to create it.</p><p>These don&#8217;t always go together. <a href="https://www.timeout.com/movies/in-time">In Time</a> has a great premise: people buy and sell years of their lives, so the rich can live forever while the poor struggle to survive the day. But its flat characters and generic chase scenes never live up to that idea. <a href="https://www.rogerebert.com/reviews/john-wick-2014">John Wick</a> goes the other way. A retired hitman gets revenge after someone kills his dog. There&#8217;s little novelty in the revenge plot, but the choreography, camera work, and Keanu Reeves&#8217;s performance make it compelling.</p><p>The tools of creative execution have already changed enormously. Writers have gone from handwriting to typewriters to word processors. Music production has expanded from recording instruments to synthesizers, samples, and virtual instruments. Software can even supply <a href="https://support.apple.com/guide/logicpro/session-players-overview-lgcpbf624405/mac">bass, piano, and drum performances that respond to your direction</a>.</p><p>These tools let one person attempt projects that would otherwise require several people with different skills. They also change which skills matter. I don&#8217;t need to be able to play the drums to arrange a drum part on a computer, but I still need to decide what that part should sound like.</p><p>Acting is another interesting example. Because it uses the body, it&#8217;s easy to think of it mainly as a physical skill, like being able to cry on cue or deliver a line convincingly. But so much of acting is in the choices. Is the character trying to hurt the other person or get them to stay? Is the laugh sincere, nervous, or an attempt to hide something? What are they trying not to say?</p><p>If you want to see how much those choices matter, Tristan Spohn has a very addictive series comparing <a href="https://www.youtube.com/watch?v=NeeBFTOFNlA">different actors performing the same scene</a>. The words stay the same, but the scene changes. Acting on a stage, in a silent film, or in a close-up gives you different ways to express those choices.</p><p>This is also why I wouldn&#8217;t divide artists into the people with the vision and the people who merely execute it. A performer or producer contributes a vision of their own. What excites me about AI is the possibility of making more of those choices accessible to people who can&#8217;t currently realize them. I could try a different arrangement without learning another instrument. Someone with an idea for an animated film could make it without being able to draw very well.</p><p>There&#8217;s an obvious difficulty here: some of the execution being made cheaper is someone&#8217;s job.</p><p>We have historical examples of this. The American Federation of Musicians estimated that by 1930, the move to sound films had eliminated <a href="https://www.afm655.org/learn/AFMhistory.htm">22,000 jobs for musicians accompanying silent movies</a>. The fact that a new technology lets people make something more cheaply doesn&#8217;t mean the transition is painless for the people whose skills it replaces.</p><p>Two things give me hope here. I suspect many of the people whose jobs are threatened by AI have creative ambitions of their own: animators who want to direct films, or session musicians who want to make their own albums. The same tools that put their jobs at risk could also make those projects possible.</p><p>I&#8217;m also confident there will still be demand for live performances. Being in a room with a person doing something difficult has an appeal of its own. As digital content becomes more abundant, my guess is that these experiences will become even more valuable. So maybe actors will have to go back to the stage, or musicians will have to go back to live performance.</p><p>There&#8217;s also a difference between having access to a powerful tool and making something worth sharing with it. The possibility I&#8217;m excited about is a process of collaboration. You describe what you want, see or hear a version of it, and work out what needs to change. The chorus arrives too early. The vocal is too polished. The character looks angry when they should look like they&#8217;re trying not to cry. You try again. Sometimes the result helps you realize that your original idea was wrong.</p><p>That can involve a lot of judgment. You need to notice the difference between something that merely looks finished and something that expresses what you wanted. A generated result can also contain choices you never asked for, so part of the work is deciding which of those choices belong in the piece. AI lowers the barrier to entry, but it doesn&#8217;t remove the need for effort. In fact, <a href="https://www.dictionary.com/browse/ai-slop">low effort is part of the definition of AI slop</a>. You still have to pay attention, reject things that don&#8217;t work, and keep refining the result. Skipping that work is how you end up with slop.</p><p>For now, I&#8217;m firmly in support of AI as a tool for creative execution. I want more people to be able to make the things they imagine. That includes people who have spent years developing a craft, and people like me whose unfinished ideas keep accumulating in a notes app.</p><p>Whether AI will also replace creative vision is a more complicated question, and one I&#8217;ll leave for a future post.</p><p>For now, I&#8217;ve got a song to produce.</p>]]></content:encoded></item></channel></rss>