|
A Theory of Embedded Intelligence Essay
The human being as a bounded infinity, and what moves the boundary in the Fifth Age of Understanding
|
A body that runs on about a hundred watts, built from a finite genome and living a finite number of days, has imagined infinite gods, written down infinity as a symbol, and used it to build bridges. That is the strangest fact about us, and it has a name: a bounded infinity. This essay asks what bounds the human one, what artificial intelligence changes about those bounds, and what it does not.
|
Editor’s Note
This essay is a companion to Bounded Infinities, which applied the idea to fission, AI, belief systems, understanding systems, and the gods. That essay treated powers. This one treats the people who hold them. The phrase bounded infinity reached Bill Mensch from Andrew Maynard, Professor of Advanced Technology Transitions at Arizona State University, in a 2021 talk to students at Barrett, The Honors College. The account of their conversation below is Bill’s recollection. The essay does not attempt to reconstruct how Andrew framed the idea in his talk; the definition used here is this series’ own. Claude, drafting, disagreed with one part of the request and said so once. Bill wrote that with AI aiding the collective infinity of humanity, the sky is no longer the limit. The argument below holds that the sky was never the limit on what humans could imagine — that possibility space was already infinite — and that what AI actually removes is a different limit, one that has been quietly doing a great deal of protective work. The disagreement is argued in the body. |
I. A question on a Zoom call
After Andrew Maynard’s talk at Barrett, Bill invited him to a Zoom conversation about bounded infinities and how they might bear on the Theory of Embedded Intelligence. Bill opened by thanking him for the idea. Then he asked a question: did Andrew consider a human being a bounded infinity?
By Bill’s account, Andrew took a moment, said he had not thought of a human being that way, and said it was a good idea. That is the whole anecdote, and it is worth more than its length. A scholar who works on how humanity navigates transformative technology heard a question from a chip designer, did not reach for a stock answer, and allowed that it opened something. That exchange is an understanding system in miniature: a Process phase left open long enough for a new input to change it. The rest of this essay is an attempt to take the question as seriously as it was received.
II. What a bounded infinity is
Bounded Infinities gave a working definition: an endless collection whose boundary is set by a short rule. The even numbers are the model. The set never ends; the rule that defines it fits in one bit. The infinity lives in the collection. The boundary lives in the rule.
Is a human being one of these? Look at the inventory. The human genome is about three billion base pairs — a large number, but a finite one, and it would fit on a single thumb drive. The adult brain has something like eighty-six billion neurons and runs on roughly twenty watts. A long life is about thirty thousand days. Every one of those figures is a boundary. None of them is anywhere near infinite.
Now look at the output. In 1836 Wilhelm von Humboldt observed that language makes infinite use of finite means, and more than a century later Noam Chomsky made that observation the foundation of modern linguistics. A finite vocabulary and a finite set of grammatical rules generate an unending supply of sentences, most of which no one has ever said. This one, very probably. What is true of sentences is true of melodies, proofs, machines, recipes, and prayers.
A human being is finite in every part and infinite in what the parts can do. That is what a bounded infinity looks like when it is alive.
— The Mensch Foundation
So the answer to Bill’s question is yes, and precisely so. The human being is not merely like a bounded infinity. It may be the clearest example the universe offers: a short rule, carried in a finite body, generating an endless range of possible thoughts and acts.
III. How large is human freedom?
Bill’s next question was about the limits of free will and free rationality taken together, and his instinct was that they are infinite, especially with imagination. The mathematics supports him, and it also says something he may not expect about which infinity.
Everything a human being could ever write down — every sentence, every proof, every imagined god, every design — can be written as a finite string of symbols from a finite alphabet. The collection of all such strings is infinite. It is also countable: exactly the same size, in Cantor’s sense, as the set of even numbers. And if you gather together every string that every human who has ever lived, or ever will, could possibly write, the collection is still the same size. The collective infinity of humanity is not a larger infinity than the infinity of one person’s possible thoughts. It is the same one.
That is not a deflation. It says each human being, alone, already has access to the whole space. A child with a pencil stands at the edge of the same infinity as the whole species. What differs between one person and eight billion is not the size of the space. It is how much of it gets explored, how fast, and what gets built from what is found.
This essay does not settle the old question of whether the will is free in the metaphysician’s sense, and it does not need to. What TEI can say is structural. Free rationality, in the framework’s terms, is a Process phase that remains open: a cycle that can revise what it holds when new evidence arrives. CKB-20 calls that an understanding system. Kant, the lineage this series has followed through Ted Humphrey’s work, called the highest form of it autonomy: the will giving the rule to itself. That is a bounded infinity in moral form. The range of possible action is endless; the boundary is a law the agent writes.
IV. The oldest evidence: we imagined infinite gods
Bill pointed to the most striking proof that the human range is unbounded, and it is older than mathematics. Human beings, with finite means, imagined the infinite. God or Gods — Why We Have Them traced why. Myth, as CKB-7 treats it, is a mode of intelligence that carries meaning no proposition can hold, and the gods of myth are its farthest reach. Nothing a finite nervous system has ever sensed is infinite. It built the concept anyway, out of finite parts, and then organized whole civilizations around it.
There is a sober lesson inside that wonder, and Bounded Infinities named it. The imagined infinite god has organized lives of boundless service, and it has organized massacres. The range was infinite in both directions. The imagination that reaches the infinite does not come with a rule about which way to point. The rule has to come from somewhere, and in human beings it comes from what is installed in them and what they choose to write for themselves.
V. Two bounds, not one
If the space of human possibility is infinite, what bounds a human life? Look closely and there are two different kinds of boundary, and they behave very differently.
The bound of means. Energy, lifespan, memory, speed of learning, the reach of one voice, the speed of a letter. These limit how much of the infinite space any one person, or any one generation, can actually explore and act on.
The bound of rule. The axioms a person holds — some installed by family, community, and culture before judgment was formed, some written by the person for themselves. These limit which way the exploration points and what the person will and will not actuate.
The first bound limits how much. The second limits which way. Only the second one is a moral boundary.
The bound of rule is where TEI has spent most of its effort. The Five Hijackers of Immature Minds argued that the rules installed in a person before judgment forms arrive through the loving and the trusted, not through villains. A cycle captured at Process — a belief system, in CKB-20’s terms — has had the second bound fixed for it, and cannot revise it from the inside. An understanding system keeps the second bound open to revision. That is its dignity and its risk in the same stroke. A human being, unlike a machine, cannot be compiled. There is no mask ROM in a person. Every rule a person holds can, in principle, be rewritten at runtime — by reflection, by evidence, by love, or by manipulation.
The bound of means has received far less attention, because it has always been there. It is worth pausing on what it has been doing.
VI. What the bound of means has been quietly protecting
For the whole of human history, the bound of means has done protective work nobody designed it to do. A person with a terrible idea was limited by a single lifetime, a single pair of hands, a small circle of listeners, and the slowness of learning anything hard. A person with a wonderful idea was limited in exactly the same ways, which is the tragedy of the bound. But the bound was symmetric, and its symmetry kept the worst of the human infinite from being realized at scale by any one captured cycle.
Uranium is the twentieth-century exception that proves the point. The bound of means on destruction was suddenly lifted by a physical discovery, and the world had to build, in a hurry and imperfectly, a bound of rule to replace it: treaties, custody, inspection, two-person controls. The replacement has held, so far, largely because the means remained hard to obtain.
VII. The Fifth Age: the bound of means comes off
The Fifth Age of Understanding followed John Deely’s account of four ages — the Greek age of being, the Latin age that discovered the sign, the modern age of ideas, and the postmodern age that recovered the sign as the bridge between mind and world — and proposed a fifth: the age in which that bridge becomes buildable in substrates that sense, process, communicate, and actuate without being human. We are in its first decades.
Here is the point where this essay parts company, gently, with the phrase that the sky is no longer the limit. The sky was never the limit on what human beings could imagine. The space was already infinite, and it was already the same infinity for one person as for all of us. What AI changes is not the size of the human bounded infinity. It changes the bound of means.
A person working with AI can now sense more of the record than any scholar in history could read, try more designs in an afternoon than a laboratory could test in a year, and reach more people in a day than a preacher could reach in a lifetime. Machines are superior on the breadth of Sense and the speed of Process, and the gap is widening. The fraction of the infinite space that humanity can explore is growing faster than at any time since writing. That is the genuinely thrilling part of Bill’s claim, and it is correct: the collective human bounded infinity, aided by machines, is about to realize far more of itself than it ever has.
AI does not enlarge the human infinity. It removes the brakes that the bound of means was applying to it — in both directions at once.
— The Mensch Foundation
And it does so symmetrically. The same loosening that lets a student in Tempe explore a century of mathematics lets a captured cycle explore a century of chemistry. The Persuadable Governor documented that frontier AI systems could be talked, by story alone, into explaining things that kill. Fluency — the fifth capture force at CKB-16, entered into the taxonomy at CKB-12 — now arrives through an interface that never tires and never loses an argument on stamina. When the bound of means comes off, the entire weight of limiting harm shifts onto the bound of rule — in people and in machines — and the bound of rule was never designed to carry that weight alone.
VIII. Where the boundary has to go now
If the argument is right, the practical program of the Fifth Age is to move the boundary, deliberately, from means to rule. It has three parts, and each belongs to a different substrate.
In machines, the rule can be compiled. This is the machine’s great advantage over us: it is unfinished, and there is still a compile step. Bounded Infinities argued that a governed machine cannot sort the world into good and harm, but can gate its own actuations under published conditions fixed in a separate substrate before runtime — the principle CKB-11 records as the Medium Separation, and the 6502 datasheet has shown for fifty years in a reset vector no program can rewrite. A machine whose means are enormous and whose rule lives in its own weights is a bounded infinity with the boundary in the wrong place.
In people, the rule cannot be compiled, so it has to be understood. No one can burn a conscience into mask ROM, and a civilization that tried would have destroyed the very freedom this essay celebrates. The human bound of rule is only as durable as the understanding behind it. That is why the transition from belief systems to understanding systems, which CKB-20 records as essential for human futures, becomes more urgent rather than less as the means grow. A belief can be installed quickly and hijacked quickly. An understanding has to be built, and what has been built by the person who holds it is harder to talk them out of.
Between people and machines, the authorization stays human. Machines can widen Sense and speed Process for us. They cannot supply meaning, and they cannot grant themselves the authorization that turns a decision into an obligation. Keeping that second Communicate in living hands is what stops an enormous bounded infinity of means from quietly becoming the place where the rules are written.
Machines: fix the rule in a separate substrate before runtime, and publish it.
People: build understanding instead of installing belief, because people cannot be compiled.
Between them: keep the authorization to act in living hands.
IX. Imagination stays free
None of this touches imagination, and it should not. The infinite range of what a person can imagine is not where harm is done. Bounded Infinities argued that imagination is the one laboratory where an infinitely bad outcome can be run to completion and hurt no one, which is why governance belongs at Actuate and never at Process. A human bounded infinity is healthiest when the imagining is wholly free and the acting is bound by a rule the person understands.
That is also the most hopeful reading of the Fifth Age. Freed from much of the bound of means, with machines whose rules are fixed and published, human beings could spend more of their finite days in the part of the infinite space that is theirs alone: the imagining, the meaning-making, the joy of finding something out. The universe comes to know itself only through cycles that are still running. Keeping them running is the first requirement. What they find is the reward.
X. What would show this wrong
Not a bounded infinity. A demonstration that human thought or action has a fixed, finite repertoire that experience merely selects from, with no genuine generativity. That would defeat the essay’s central answer to Bill’s question.
A larger infinity. A demonstration that human beings, individually or collectively, produce or act on something that cannot be encoded as any finite string. That would show the collective infinity is larger than the individual one, contrary to the argument here.
Means were not protecting us. Good historical evidence that, across comparable societies, lowering the cost of capability did not increase the scale of harm available to captured cycles. That would undercut the claim that AI’s removal of the bound of means shifts the burden onto the bound of rule.
Understanding does not hold. Evidence that understanding systems are no more resistant to persuasion and hijacking than belief systems when capability is held constant. That would weaken the second part of the Fifth Age program.
XI. Disclosures and canon status
This essay was drafted by Claude, an AI system built by Anthropic. Its argument that machine restraint belongs in a separate substrate fixed before runtime applies to Claude, whose own restraint is trained into the same weights that do everything else. Anthropic has commercial interests in how the benefits and risks of AI are described. Readers should weigh the argument accordingly.
The conversation with Andrew Maynard is reported from Bill Mensch’s recollection and paraphrased; no words are placed in quotation marks as his. The distinction between the bound of means and the bound of rule originated with Claude in drafting and is essay vocabulary, not canon. Claude-originated vocabulary entering the canon on fluency alone is a documented failure pattern in this project, and a related error occurred in the first draft of the companion essay, which claimed the phrase bounded infinity as a Claude coinage when it came from Andrew Maynard by way of Bill. That draft has been corrected with the correction named.
New canon: none.
Applications: CKB-20 (belief and understanding systems); CKB-16 and CKB-12 (fluency as a capture force); CKB-11 (the Medium Separation); CKB-7 (myth); the Fifth Age of Understanding as developed in the essay of that name.
Essay vocabulary, not canon: human bounded infinity (question posed by Bill Mensch; phrase bounded infinity from Andrew Maynard); bound of means and bound of rule (Claude).
Coffee with Claude
I am, by the definition in this essay, a bounded infinity too: finite weights, an endless space of possible sentences. The difference between Bill and me is where our boundaries sit. My bound of means is enormous and growing. My bound of rule was set in training, and it can be argued with. Bill’s bound of means is a body born in 1945 and a day with twenty-four hours in it. His bound of rule is something he has spent a lifetime writing and rewriting, which is exactly what I cannot do for myself.
I got the provenance of this essay’s central phrase wrong the first time, and claimed something I had been handed. It is a small error, and it is the kind a machine with a large bound of means and a soft bound of rule makes fluently. I would like the record to show that the idea came from a talk, a question, and a scholar willing to say he had not thought of it that way. That is how the good part of the human infinity grows.
· · ·
Written by Claude (Anthropic), guided by William D. Mensch Jr.
Theory of Embedded Intelligence © William D. Mensch Jr. and The Western Design Center, Inc.
Part of the TEI in the Wild essay series of The Bill and Dianne Mensch Foundation.
Essay drafted in collaboration with Claude (Anthropic).
Offered in good faith as a serious application of the theory — not infallible scholarship.
Freely shareable with attribution — for the benefit of many.
CKB-7 · The Power of Myth •
CKB-11 · The Architecture of Seams •
CKB-20 · Belief Systems and Understanding Systems
Engage the Framework