{"id":846,"date":"2026-09-21T22:00:11","date_gmt":"2026-09-21T16:30:11","guid":{"rendered":"https:\/\/brainstorms.in\/?p=846"},"modified":"2026-09-21T22:00:11","modified_gmt":"2026-09-21T16:30:11","slug":"neural-network-explainer","status":"publish","type":"post","link":"https:\/\/brainstorms.in\/?p=846","title":{"rendered":"Neural Network Explainer"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">01 \u2014 The inspiration<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Borrowed from the brain<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Your brain is built from cells called neurons. Each one collects signals from its neighbors, and if those signals add up to enough, it fires a signal of its own down a long fiber to the next cell. Nothing about a single neuron is smart \u2014 the intelligence comes from billions of them, wired together.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">An <strong>artificial neuron<\/strong> is a deliberately crude copy of that idea, built entirely from numbers. It keeps the shape of the original \u2014 gather signals, combine them, decide whether to pass something on \u2014 and throws away everything else.Biological neurondendritescell bodyaxonsynapsesArtificial neuroninputsx1x2x3?weighted sumoutput<strong>The two do the same job.<\/strong> Dendrites become numeric inputs, the cell body&#8217;s summing becomes a weighted sum, and the axon&#8217;s fire-or-don&#8217;t-fire becomes a single output number.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><a href=\"https:\/\/brainstorms.in\/wp-content\/uploads\/2026\/09\/1.png\"><img loading=\"lazy\" decoding=\"async\" width=\"754\" height=\"424\" src=\"https:\/\/brainstorms.in\/wp-content\/uploads\/2026\/09\/1.png\" alt=\"\" class=\"wp-image-847\" srcset=\"https:\/\/brainstorms.in\/wp-content\/uploads\/2026\/09\/1.png 754w, https:\/\/brainstorms.in\/wp-content\/uploads\/2026\/09\/1-400x225.png 400w, https:\/\/brainstorms.in\/wp-content\/uploads\/2026\/09\/1-300x169.png 300w\" sizes=\"auto, (max-width: 754px) 100vw, 754px\" \/><\/a><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">02 \u2014 The building block<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">One neuron, deciding something small<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">A single artificial neuron does three things: it multiplies each input by a <strong>weight<\/strong> (how much that input matters), adds a <strong>bias<\/strong> (a built-in nudge), and passes the result through a rule that turns the sum into an output. Here&#8217;s one deciding whether to go outside.1Sunny?value = 11Free this evening?value = 10Raining?value = 0weight 0.7weight 0.5weight ?0.9?bias ?0.5sum = 0.7Go outside<strong>0.7 \u00d7 1 + 0.5 \u00d7 1 ? 0.9 \u00d7 0 ? 0.5 = 0.7.<\/strong> Because the result is above zero, this neuron&#8217;s rule says &#8220;fire&#8221; \u2014 output: go outside. Change the weights and it would weigh the same facts differently.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The weights and the bias are the only things a network actually contains. Everything you&#8217;ve heard about a network &#8220;knowing&#8221; something really means: <em>its weights happen to be set to useful values.<\/em><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">03 \u2014 The network<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><a href=\"https:\/\/brainstorms.in\/wp-content\/uploads\/2026\/09\/2.png\"><img loading=\"lazy\" decoding=\"async\" width=\"754\" height=\"424\" src=\"https:\/\/brainstorms.in\/wp-content\/uploads\/2026\/09\/2.png\" alt=\"\" class=\"wp-image-848\" srcset=\"https:\/\/brainstorms.in\/wp-content\/uploads\/2026\/09\/2.png 754w, https:\/\/brainstorms.in\/wp-content\/uploads\/2026\/09\/2-400x225.png 400w, https:\/\/brainstorms.in\/wp-content\/uploads\/2026\/09\/2-300x169.png 300w\" sizes=\"auto, (max-width: 754px) 100vw, 754px\" \/><\/a><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">Wiring thousands of them together<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">One neuron can only weigh a few facts. Real problems \u2014 a photo, a sentence, a sound clip \u2014 need many neurons arranged in <strong>layers<\/strong>: an input layer that takes in raw data, one or more hidden layers that combine it in increasingly abstract ways, and an output layer that gives the final answer.Input layerHidden layerOutput layerCatNot cat<strong>Every line is its own weight.<\/strong> This small example has thirty of them; a real image-recognition network has millions. Each hidden neuron combines the whole input layer in its own slightly different way, so together the layer can notice edges, then shapes, then whole features.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><a href=\"https:\/\/brainstorms.in\/wp-content\/uploads\/2026\/09\/3.png\"><img loading=\"lazy\" decoding=\"async\" width=\"768\" height=\"500\" src=\"https:\/\/brainstorms.in\/wp-content\/uploads\/2026\/09\/3.png\" alt=\"\" class=\"wp-image-849\" srcset=\"https:\/\/brainstorms.in\/wp-content\/uploads\/2026\/09\/3.png 768w, https:\/\/brainstorms.in\/wp-content\/uploads\/2026\/09\/3-300x195.png 300w, https:\/\/brainstorms.in\/wp-content\/uploads\/2026\/09\/3-400x260.png 400w\" sizes=\"auto, (max-width: 768px) 100vw, 768px\" \/><\/a><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">04 \u2014 Learning<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Where do the weights come from?<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Nobody sets millions of weights by hand. Instead, the network starts with random ones \u2014 it guesses badly on purpose \u2014 and then <strong>trains<\/strong>: it repeats a short loop, thousands or millions of times, each time getting slightly less wrong.Show a labeled example&#8221;this photo is a cat&#8221;Network guesses&#8221;73% cat, 27% not&#8221;Measure the errorhow far off was that?Nudge every weighta little, to lower the errorrepeat, millions of times<strong>This is the whole trick.<\/strong> The technique for calculating exactly how to nudge each weight is called <strong>backpropagation<\/strong> \u2014 it traces the error backward through the network, layer by layer, so every single weight gets its own precise correction.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Given enough labeled examples and enough loops, the weights settle into values that make good guesses \u2014 not because the network understands cats, but because those particular numbers happen to separate &#8220;cat&#8221; patterns from everything else.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><a href=\"https:\/\/brainstorms.in\/wp-content\/uploads\/2026\/09\/4.png\"><img loading=\"lazy\" decoding=\"async\" width=\"733\" height=\"578\" src=\"https:\/\/brainstorms.in\/wp-content\/uploads\/2026\/09\/4.png\" alt=\"\" class=\"wp-image-850\" srcset=\"https:\/\/brainstorms.in\/wp-content\/uploads\/2026\/09\/4.png 733w, https:\/\/brainstorms.in\/wp-content\/uploads\/2026\/09\/4-300x237.png 300w, https:\/\/brainstorms.in\/wp-content\/uploads\/2026\/09\/4-400x315.png 400w\" sizes=\"auto, (max-width: 733px) 100vw, 733px\" \/><\/a><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">05 \u2014 Putting it together<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">A trained network, at work<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Once training is done, using the network is fast and simple: one forward pass through the layers, no more adjusting. Here&#8217;s a (greatly simplified) network reading a handwritten digit.pixels inthe trained networkconfidence per digit0123456789<strong>No pixel means &#8220;seven&#8221; on its own.<\/strong> Each hidden neuron responds to a small pattern of pixels; combined across the layers, that adds up to one output standing far above the rest.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><a href=\"https:\/\/brainstorms.in\/wp-content\/uploads\/2026\/09\/5.png\"><img loading=\"lazy\" decoding=\"async\" width=\"774\" height=\"381\" src=\"https:\/\/brainstorms.in\/wp-content\/uploads\/2026\/09\/5.png\" alt=\"\" class=\"wp-image-851\" srcset=\"https:\/\/brainstorms.in\/wp-content\/uploads\/2026\/09\/5.png 774w, https:\/\/brainstorms.in\/wp-content\/uploads\/2026\/09\/5-300x148.png 300w, https:\/\/brainstorms.in\/wp-content\/uploads\/2026\/09\/5-768x378.png 768w, https:\/\/brainstorms.in\/wp-content\/uploads\/2026\/09\/5-400x197.png 400w\" sizes=\"auto, (max-width: 774px) 100vw, 774px\" \/><\/a><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">06 \u2014 Keeping it honest<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">What this picture leaves out<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Real networks are this idea taken to extremes rather than something fundamentally different. A large language model has many layers and billions of weights instead of thirty; images pass through neurons arranged to scan for local patterns rather than see every pixel at once; and training needs carefully chosen examples, because a network only ever gets as good as what it was shown \u2014 bias in the examples becomes bias in the weights.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">It&#8217;s also worth being plain about what a network is <em>not<\/em> doing. It has no model of the world, no goals, and no awareness of what it&#8217;s looking at \u2014 it is a fixed mathematical function, shaped by training, that turns one set of numbers into another. That function can be extraordinarily useful without there being anyone &#8220;home&#8221; inside it.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">A short glossary<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">NeuronA unit that multiplies its inputs by weights, adds a bias, and passes the sum through an activation rule.WeightA number that scales how much one input matters to a neuron. Training is mostly the process of adjusting these.BiasAn extra number added to the sum, letting a neuron fire more or less easily regardless of its inputs.Activation functionThe rule that turns a neuron&#8217;s sum into its output \u2014 often something like &#8220;pass it through if positive, otherwise send near-zero.&#8221;LayerA group of neurons that all take input from the same previous group and hand their output to the same next group.BackpropagationThe method used during training to work out exactly how much to adjust each weight, based on how wrong the final guess was.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>01 \u2014 The inspiration Borrowed from the brain Your brain is built from cells called neurons. Each one collects signals from its neighbors, and if those signals add up to enough, it fires a signal of its own down a long fiber to the next cell. Nothing about a single neuron is smart \u2014 the&hellip; <a href=\"https:\/\/brainstorms.in\/?p=846\" class=\"more-link\">Continue reading <span class=\"screen-reader-text\">Neural Network Explainer<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[],"class_list":["post-846","post","type-post","status-publish","format-standard","hentry","category-computers"],"_links":{"self":[{"href":"https:\/\/brainstorms.in\/index.php?rest_route=\/wp\/v2\/posts\/846","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/brainstorms.in\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/brainstorms.in\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/brainstorms.in\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/brainstorms.in\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=846"}],"version-history":[{"count":1,"href":"https:\/\/brainstorms.in\/index.php?rest_route=\/wp\/v2\/posts\/846\/revisions"}],"predecessor-version":[{"id":852,"href":"https:\/\/brainstorms.in\/index.php?rest_route=\/wp\/v2\/posts\/846\/revisions\/852"}],"wp:attachment":[{"href":"https:\/\/brainstorms.in\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=846"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/brainstorms.in\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=846"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/brainstorms.in\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=846"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}