<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:itunes="http://www.itunes.com/dtds/podcast-1.0.dtd" xmlns:googleplay="http://www.google.com/schemas/play-podcasts/1.0"><channel><title><![CDATA[Breaking Math: Noah's Notes]]></title><description><![CDATA[Noah’s Notes is the data-driven corner of Breaking Math, where Noah unpacks the algorithms, models, and mathematical systems shaping modern life. From AI and optimization to ranking systems, networks, statistics, and the hidden logic behind digital platforms. Think of it as part field journal, part proof sketch, and part intellectual rabbit hole.]]></description><link>https://breakingmath.substack.com/s/noahs-notes</link><image><url>https://substackcdn.com/image/fetch/$s_!SCID!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5d53a06b-f11d-4aeb-8869-829c37b7d549_500x500.jpeg</url><title>Breaking Math: Noah&apos;s Notes</title><link>https://breakingmath.substack.com/s/noahs-notes</link></image><generator>Substack</generator><lastBuildDate>Sat, 20 Jun 2026 09:22:46 GMT</lastBuildDate><atom:link href="https://breakingmath.substack.com/feed" rel="self" type="application/rss+xml"/><copyright><![CDATA[Breaking Math]]></copyright><language><![CDATA[en]]></language><webMaster><![CDATA[breakingmath@substack.com]]></webMaster><itunes:owner><itunes:email><![CDATA[breakingmath@substack.com]]></itunes:email><itunes:name><![CDATA[Breaking Math]]></itunes:name></itunes:owner><itunes:author><![CDATA[Breaking Math]]></itunes:author><googleplay:owner><![CDATA[breakingmath@substack.com]]></googleplay:owner><googleplay:email><![CDATA[breakingmath@substack.com]]></googleplay:email><googleplay:author><![CDATA[Breaking Math]]></googleplay:author><itunes:block><![CDATA[Yes]]></itunes:block><item><title><![CDATA[Opinion: AI is a mathematical flipbook, not a digital consciousness]]></title><description><![CDATA[If our current approach to AI is leading to consciousness, we should be able to pin down where it might come in. Let&#8217;s give it a try!]]></description><link>https://breakingmath.substack.com/p/opinion-ai-is-a-mathematical-flipbook</link><guid isPermaLink="false">https://breakingmath.substack.com/p/opinion-ai-is-a-mathematical-flipbook</guid><dc:creator><![CDATA[Noah Giansiracusa]]></dc:creator><pubDate>Fri, 08 May 2026 12:29:38 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/ba535f0e-f713-4aa6-8e5c-7352c1cb155c_1038x540.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<h1><strong>How neural networks work, and how to think of them as Legos.</strong> </h1><p>All the AI systems in vogue today are built around neural networks, so that&#8217;ll be the focus in this discussion. A neural network is just a specific kind of math function, like f(x) = x<sup>2</sup> or f(x) = sin(x), except much bigger and more complicated. Rather than writing down an explicit formula, we describe the mathematical building blocks it is made from and how these pieces fit together, like how a Lego set comes with an instruction booklet telling you how to assemble the Lego blocks.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!PWiA!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb7a43572-2667-487a-9942-37d771ca5640_499x649.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!PWiA!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb7a43572-2667-487a-9942-37d771ca5640_499x649.png 424w, https://substackcdn.com/image/fetch/$s_!PWiA!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb7a43572-2667-487a-9942-37d771ca5640_499x649.png 848w, https://substackcdn.com/image/fetch/$s_!PWiA!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb7a43572-2667-487a-9942-37d771ca5640_499x649.png 1272w, https://substackcdn.com/image/fetch/$s_!PWiA!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb7a43572-2667-487a-9942-37d771ca5640_499x649.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!PWiA!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb7a43572-2667-487a-9942-37d771ca5640_499x649.png" width="499" height="649" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b7a43572-2667-487a-9942-37d771ca5640_499x649.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:649,&quot;width&quot;:499,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!PWiA!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb7a43572-2667-487a-9942-37d771ca5640_499x649.png 424w, https://substackcdn.com/image/fetch/$s_!PWiA!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb7a43572-2667-487a-9942-37d771ca5640_499x649.png 848w, https://substackcdn.com/image/fetch/$s_!PWiA!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb7a43572-2667-487a-9942-37d771ca5640_499x649.png 1272w, https://substackcdn.com/image/fetch/$s_!PWiA!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb7a43572-2667-487a-9942-37d771ca5640_499x649.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!GXz7!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3988578c-d1b2-4945-87d4-fe52eb827f2a_740x456.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!GXz7!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3988578c-d1b2-4945-87d4-fe52eb827f2a_740x456.png 424w, https://substackcdn.com/image/fetch/$s_!GXz7!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3988578c-d1b2-4945-87d4-fe52eb827f2a_740x456.png 848w, https://substackcdn.com/image/fetch/$s_!GXz7!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3988578c-d1b2-4945-87d4-fe52eb827f2a_740x456.png 1272w, https://substackcdn.com/image/fetch/$s_!GXz7!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3988578c-d1b2-4945-87d4-fe52eb827f2a_740x456.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!GXz7!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3988578c-d1b2-4945-87d4-fe52eb827f2a_740x456.png" width="740" height="456" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/3988578c-d1b2-4945-87d4-fe52eb827f2a_740x456.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:456,&quot;width&quot;:740,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!GXz7!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3988578c-d1b2-4945-87d4-fe52eb827f2a_740x456.png 424w, https://substackcdn.com/image/fetch/$s_!GXz7!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3988578c-d1b2-4945-87d4-fe52eb827f2a_740x456.png 848w, https://substackcdn.com/image/fetch/$s_!GXz7!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3988578c-d1b2-4945-87d4-fe52eb827f2a_740x456.png 1272w, https://substackcdn.com/image/fetch/$s_!GXz7!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3988578c-d1b2-4945-87d4-fe52eb827f2a_740x456.png 1456w" sizes="100vw"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><em>The figures in AI research papers (like the famous transformers one above) are like the instruction manuals in Lego boxes explaining how the different bricks fit together.</em></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://breakingmath.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">This Substack is reader-supported. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p>Most of the mathematical pieces in neural networks involve coefficients, like how the quadratic function f(x) = ax<sup>2</sup> + bx + c has three coefficients a, b, c. Choosing different values for the three coefficients in this quadratic gives us parabolas of different shapes and locations. Choosing a specific parabola is equivalent to specifying these three numbers a,b,c, so we can think of that as choosing a point (a,b,c) in three-dimensional space. Moving that point around in space corresponds to sliding and bending the parabola around.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!CQVb!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F90c96e4b-32f3-4acf-bbeb-837f3bbf4c3d_815x636.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!CQVb!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F90c96e4b-32f3-4acf-bbeb-837f3bbf4c3d_815x636.png 424w, https://substackcdn.com/image/fetch/$s_!CQVb!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F90c96e4b-32f3-4acf-bbeb-837f3bbf4c3d_815x636.png 848w, https://substackcdn.com/image/fetch/$s_!CQVb!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F90c96e4b-32f3-4acf-bbeb-837f3bbf4c3d_815x636.png 1272w, https://substackcdn.com/image/fetch/$s_!CQVb!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F90c96e4b-32f3-4acf-bbeb-837f3bbf4c3d_815x636.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!CQVb!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F90c96e4b-32f3-4acf-bbeb-837f3bbf4c3d_815x636.png" width="815" height="636" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/90c96e4b-32f3-4acf-bbeb-837f3bbf4c3d_815x636.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:636,&quot;width&quot;:815,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!CQVb!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F90c96e4b-32f3-4acf-bbeb-837f3bbf4c3d_815x636.png 424w, https://substackcdn.com/image/fetch/$s_!CQVb!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F90c96e4b-32f3-4acf-bbeb-837f3bbf4c3d_815x636.png 848w, https://substackcdn.com/image/fetch/$s_!CQVb!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F90c96e4b-32f3-4acf-bbeb-837f3bbf4c3d_815x636.png 1272w, https://substackcdn.com/image/fetch/$s_!CQVb!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F90c96e4b-32f3-4acf-bbeb-837f3bbf4c3d_815x636.png 1456w" sizes="100vw"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><em>Choosing a parabola f(x) = ax<sup>2</sup> + bx + c is choosing three numbers (a,b,c), so a point in three-dimensional space&#8212;like specifying latitude, longitude, altitude.</em></p><p>If we think of a neural network in terms of Legos, we can imagine that each Lego has a shape but also that we are choosing a color for each bump on the Lego.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!8z91!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8ef62c5b-5706-4316-9c64-6df4a162344f_520x439.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!8z91!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8ef62c5b-5706-4316-9c64-6df4a162344f_520x439.png 424w, https://substackcdn.com/image/fetch/$s_!8z91!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8ef62c5b-5706-4316-9c64-6df4a162344f_520x439.png 848w, https://substackcdn.com/image/fetch/$s_!8z91!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8ef62c5b-5706-4316-9c64-6df4a162344f_520x439.png 1272w, https://substackcdn.com/image/fetch/$s_!8z91!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8ef62c5b-5706-4316-9c64-6df4a162344f_520x439.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!8z91!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8ef62c5b-5706-4316-9c64-6df4a162344f_520x439.png" width="520" height="439" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/8ef62c5b-5706-4316-9c64-6df4a162344f_520x439.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:439,&quot;width&quot;:520,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!8z91!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8ef62c5b-5706-4316-9c64-6df4a162344f_520x439.png 424w, https://substackcdn.com/image/fetch/$s_!8z91!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8ef62c5b-5706-4316-9c64-6df4a162344f_520x439.png 848w, https://substackcdn.com/image/fetch/$s_!8z91!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8ef62c5b-5706-4316-9c64-6df4a162344f_520x439.png 1272w, https://substackcdn.com/image/fetch/$s_!8z91!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8ef62c5b-5706-4316-9c64-6df4a162344f_520x439.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Human designers choose how many Legos to use, what shape each is, and how they fit together&#8212;this is the &#8220;architecture&#8221; of the neural net&#8212;but they don&#8217;t choose the colors on all these Lego bumps. Those start out randomly, then &#8220;training&#8221; the neural network is the process of steadily tweaking all the colors to make the Lego contraption perform better at the task(s) you&#8217;re interested in.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!bNul!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a8fce43-e85c-4c2b-8866-972b77f420eb_543x719.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!bNul!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a8fce43-e85c-4c2b-8866-972b77f420eb_543x719.png 424w, https://substackcdn.com/image/fetch/$s_!bNul!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a8fce43-e85c-4c2b-8866-972b77f420eb_543x719.png 848w, https://substackcdn.com/image/fetch/$s_!bNul!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a8fce43-e85c-4c2b-8866-972b77f420eb_543x719.png 1272w, https://substackcdn.com/image/fetch/$s_!bNul!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a8fce43-e85c-4c2b-8866-972b77f420eb_543x719.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!bNul!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a8fce43-e85c-4c2b-8866-972b77f420eb_543x719.png" width="543" height="719" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/2a8fce43-e85c-4c2b-8866-972b77f420eb_543x719.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:719,&quot;width&quot;:543,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!bNul!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a8fce43-e85c-4c2b-8866-972b77f420eb_543x719.png 424w, https://substackcdn.com/image/fetch/$s_!bNul!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a8fce43-e85c-4c2b-8866-972b77f420eb_543x719.png 848w, https://substackcdn.com/image/fetch/$s_!bNul!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a8fce43-e85c-4c2b-8866-972b77f420eb_543x719.png 1272w, https://substackcdn.com/image/fetch/$s_!bNul!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a8fce43-e85c-4c2b-8866-972b77f420eb_543x719.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Modern systems like GPT5.5 are built out of so many large Legos that in total there are <a href="https://arxiv.org/pdf/2604.24827">likely</a> trillions of colors to choose. (The official name for these colors is &#8220;parameters&#8221; or &#8220;weights.&#8221;) So GPT5.5 is built by:</p><p>1. manually writing down the Lego instruction booklet (that&#8217;s what the AI designers do)</p><p>2. randomly choosing a point in the trillion-dimensional space representing the possible colors for all the Lego bumps (this is the neural network&#8217;s random initialization)</p><p>3. training the neural network (which can include static data like all the text on the internet, and dynamic data like human or AI evaluators rating the answers the AI gives to various prompt), which gently moves that point in trillion-dimensional space around toward some goal, such as being able to provide answers that users find more useful.</p><h1><strong>Wherefore art thou consciousness? </strong></h1><p>The architecture for a neural network surely has no consciousness&#8212;remember, it is just the Lego instruction booklet, and it doesn&#8217;t even specify the Lego colors. It is a blueprint, not a building, and an incomplete one at that. So, we must look beyond Step 1 in the above list.</p><p>I don&#8217;t think the neural network we construct in Step 2 could be considered conscious. It is just a bunch of random numbers that have seen no data, attempted no tasks, received no feedback. It is the static you saw on your old TV before you tuned to a channel.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!quOn!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5e89a1d-5911-495e-b2bf-860e36a14ba8_834x582.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!quOn!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5e89a1d-5911-495e-b2bf-860e36a14ba8_834x582.png 424w, https://substackcdn.com/image/fetch/$s_!quOn!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5e89a1d-5911-495e-b2bf-860e36a14ba8_834x582.png 848w, https://substackcdn.com/image/fetch/$s_!quOn!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5e89a1d-5911-495e-b2bf-860e36a14ba8_834x582.png 1272w, https://substackcdn.com/image/fetch/$s_!quOn!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5e89a1d-5911-495e-b2bf-860e36a14ba8_834x582.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!quOn!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5e89a1d-5911-495e-b2bf-860e36a14ba8_834x582.png" width="834" height="582" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c5e89a1d-5911-495e-b2bf-860e36a14ba8_834x582.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:582,&quot;width&quot;:834,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!quOn!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5e89a1d-5911-495e-b2bf-860e36a14ba8_834x582.png 424w, https://substackcdn.com/image/fetch/$s_!quOn!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5e89a1d-5911-495e-b2bf-860e36a14ba8_834x582.png 848w, https://substackcdn.com/image/fetch/$s_!quOn!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5e89a1d-5911-495e-b2bf-860e36a14ba8_834x582.png 1272w, https://substackcdn.com/image/fetch/$s_!quOn!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5e89a1d-5911-495e-b2bf-860e36a14ba8_834x582.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>So, if there is consciousness, it must come from Step 3. That means our trillion-dimensional space is carved into two regions, one representing non-consciousness and the other, presumably much smaller, representing consciousness. Then the belief would be that we start by randomly throwing a dart into this enormous void of non-consciousness, and if we find the right data and the right tasks then the training process guides our dart into the conscious realm. This doesn&#8217;t seem out of the realm of possibility.</p><p>In fact, consciousness is likely a continuum, not black-and-white, so if we could measure consciousness then we could directly use that as an objective function to guide our exploration of the trillion-dimensional space. Since we can&#8217;t yet measure consciousness, we can at least imagine that training on the right data in the right way serves as a rough proxy&#8212;so that by forcing our neural network to get better at doing the things we want, like chatting with us and answering our questions, we inadvertently move uphill in the mountain range of consciousness over our trillion-dimensional space.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!NQny!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F18eb6303-de7a-410b-a4a6-244997af94aa_665x657.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!NQny!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F18eb6303-de7a-410b-a4a6-244997af94aa_665x657.png 424w, https://substackcdn.com/image/fetch/$s_!NQny!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F18eb6303-de7a-410b-a4a6-244997af94aa_665x657.png 848w, https://substackcdn.com/image/fetch/$s_!NQny!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F18eb6303-de7a-410b-a4a6-244997af94aa_665x657.png 1272w, https://substackcdn.com/image/fetch/$s_!NQny!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F18eb6303-de7a-410b-a4a6-244997af94aa_665x657.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!NQny!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F18eb6303-de7a-410b-a4a6-244997af94aa_665x657.png" width="665" height="657" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/18eb6303-de7a-410b-a4a6-244997af94aa_665x657.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:657,&quot;width&quot;:665,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!NQny!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F18eb6303-de7a-410b-a4a6-244997af94aa_665x657.png 424w, https://substackcdn.com/image/fetch/$s_!NQny!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F18eb6303-de7a-410b-a4a6-244997af94aa_665x657.png 848w, https://substackcdn.com/image/fetch/$s_!NQny!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F18eb6303-de7a-410b-a4a6-244997af94aa_665x657.png 1272w, https://substackcdn.com/image/fetch/$s_!NQny!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F18eb6303-de7a-410b-a4a6-244997af94aa_665x657.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>This could well be similar to the biological world: if consciousness evolved in animals, it presumably did so as a byproduct of some survival mechanism.</p><p>But then we must remember what these neural networks really are: mathematical formulas. If we are lucky enough to train/evolve our way to a conscious neural network, are we saying that the math formula itself is conscious? Surely if we wrote this formula down by hand on a (very large) sheet of paper the way we write other math functions, nobody would claim it could be conscious.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!YmyM!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4e98d38-8546-4451-ac93-a27416e9b8ed_1072x532.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!YmyM!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4e98d38-8546-4451-ac93-a27416e9b8ed_1072x532.png 424w, https://substackcdn.com/image/fetch/$s_!YmyM!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4e98d38-8546-4451-ac93-a27416e9b8ed_1072x532.png 848w, https://substackcdn.com/image/fetch/$s_!YmyM!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4e98d38-8546-4451-ac93-a27416e9b8ed_1072x532.png 1272w, https://substackcdn.com/image/fetch/$s_!YmyM!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4e98d38-8546-4451-ac93-a27416e9b8ed_1072x532.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!YmyM!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4e98d38-8546-4451-ac93-a27416e9b8ed_1072x532.png" width="1072" height="532" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/e4e98d38-8546-4451-ac93-a27416e9b8ed_1072x532.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:532,&quot;width&quot;:1072,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!YmyM!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4e98d38-8546-4451-ac93-a27416e9b8ed_1072x532.png 424w, https://substackcdn.com/image/fetch/$s_!YmyM!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4e98d38-8546-4451-ac93-a27416e9b8ed_1072x532.png 848w, https://substackcdn.com/image/fetch/$s_!YmyM!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4e98d38-8546-4451-ac93-a27416e9b8ed_1072x532.png 1272w, https://substackcdn.com/image/fetch/$s_!YmyM!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4e98d38-8546-4451-ac93-a27416e9b8ed_1072x532.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Does specifying this math formula in computer code make it any more conscious? Nope. Whether we use math notation or computer code, we just have a bunch of symbols that describe a process for turning an input to an output. The difference is that with computer code we can turn the computer on, feed numbers into the function, and compute!</p><p>But&#8230; you could, in principle, do this by hand as well. Every step of every computation the computer makes when the neural network &#8220;thinks&#8221; and answers the prompts you feed it, is a math calculation that you could, in principle, write out by hand with pen and paper. I don&#8217;t think anyone believes that writing these big computations on (really big) paper could produce consciousness.</p><p>And here&#8217;s the crux. Fundamentally, it&#8217;s no different whether a computer does these computations digitally in binary or you do them manually in ink.</p><p><strong>The punchline.</strong> A photograph has no movement, yet when we string a bunch of photographs together in rapid succession, we get a convincing illusion of movement. And if the photographs are sufficiently detailed and the frame-rate higher than our eye can perceive, then the movie appears as real as life itself. But we know it isn&#8217;t.</p><p>I believe this is where we stand with AI.</p><p>All the AI we currently have, and all the AI systems we envision down the road for the foreseeable future, are just a string of mathematical computations performed in rapid succession. They may appear to produce continuous thought, perhaps even consciousness, but I strongly believe this is as illusory as the movement and life we see in film.</p><p>A math formula is not conscious. Using that math formula to turn an input number into an output number is a recipe, not consciousness. And performing many such computations in a row is a mathematical flipbook, not digital consciousness.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://breakingmath.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">This Substack is reader-supported. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item></channel></rss>