The Reliability ThesisEpisode 02
Generation Abundance Creates Verification Scarcity
The scarce resource is trustworthy judgment at the scale and speed of machine generation.
Watch Generation Abundance Creates Verification Scarcity
Transcript
Edited for readability. The argument is unchanged.
Abundance changes what is scarce
When something becomes abundant, the scarcity around it becomes more valuable.
Cheap photography increased the value of attention. Cheap publishing increased the value of trust. And cheap code generation is increasing the value of verification.
More claims to evaluate
An AI system can produce ten implementations of the same feature. That does not give an engineering leader ten times more confidence. It gives the organization ten more claims to evaluate.
The constraint is no longer whether the change can be written. The constraint is whether anyone can establish which change is correct, what it affects, and whether the evidence is strong enough for the environment in which it operates.
Tests need independent judgment
This is why more generated tests are not automatically the answer. A test is useful only if it represents a real requirement, exercises a meaningful risk, and produces evidence that distinguishes success from a plausible failure.
If the generator writes the implementation, invents the test, interprets the results, and approves itself, activity has increased, but independence has collapsed.
The scarce resource is trustworthy judgment at the scale and speed of machine generation.
Design verification to scale
The judgment does not have to be manual. It can be supported by system maps, policies, independent evaluators, runtime checks, historical behavior, and narrowly scoped approvals.
But it must be designed. It will not emerge simply because the model is more capable. This is verification scarcity.
Invest in the quality of evidence
The organizations that recognize it will invest differently. They will measure the quality of evidence, not just the quantity of code.
They will preserve independence between the actor proposing a change and the controls deciding whether it may proceed.
They will route deeper scrutiny towards actions with larger consequences.
AI gives us more possible software. Reliability determines which of those possibilities deserve to become real. That is the Reliability Thesis.
Sources and research notes
1 source
Research current through .
Infinite Drafts, Finite Judgment (opens in a new tab)
Zof AIKevin Kissi2026-10-24ResearchAccessed 2026-10-26
The companion whitepaper develops the episode into a verification-capacity model, a tenant-isolation example, and a thirty-day evaluation plan. The framework, model, measures, and pilot are Zof operating proposals.
