Harness Shrinkage as Models Improve

Sources#

• Anthropic's Boris Cherny: Why Coding Is Solved, and What Comes Next
• Claude Fable 5 and Claude Mythos 5
• How Anthropic's product team moves faster than anyone else | Cat Wu (Head of Product, Claude Code)

Summary#

The harness — prompts, skills, scaffolding, mechanical verification — exists to compensate for what the underlying model cannot yet do. As models improve, the harness needs to shrink, not grow. Boris Cherny explicitly predicts Claude Code "may be 100 lines of code a year from now." Cat Wu reports the team reads the entire system prompt with every model launch and removes anything the new model handles natively. The principle works in two directions: capabilities the harness used to inject move into the model, and crutches the harness used to provide become drag.

The to-do list as canonical example#

Cat Wu's case study:

• Early Claude Code: asked to refactor 20 call sites, the model would change 5 and stop. The team added an explicit to-do list tool ("Sid on our team was like, what would a human do? Make a list, go through one by one"). With the tool prompted aggressively, the model finished all 20.
• Opus 4 onward: model uses the to-do list spontaneously, no aggressive prompting needed.
• Today: to-do list is "deemphasized" — model may or may not use it, doesn't need to be reminded, mostly kept around for user-facing visibility.

The crutch (the prompt section forcing to-do list use) was removed; the tool stayed for a different reason (UI value).

The Boris claim: 100 lines#

"I think Claude Code itself may be 100 lines of code a year from now."

Read literally this is hyperbole, but the direction is real:

• Anthropic now uses the same models internally that ship externally, so internal harness lessons transfer
• Each model release lets the team delete prompt sections, shrink fallback logic, remove safety wrappers (per Cat Wu: "all the safety mechanisms today — prompt injection, static verification of commands, permission modes, human in the loop — will be less important because the model will just do the right thing")
• The product surface stops being "what the harness does" and becomes "where the model decides to do it" (CLI, mobile, web, IDE, all sharing the same model logic)

The flip side: capabilities migrate inward#

Boris reports Opus 4.7 spontaneously starts loops:

"I'll tell it 'pull this data query.' It says 'I noticed the data is changing — I'll start a loop and report every 30 minutes.'"

The /loop primitive (see Agent Loop Pattern) was introduced as a harness feature; in 4.7 it is becoming model-native behavior. The harness primitive doesn't go away — but the user no longer needs to invoke it.

This generalizes: anything the harness teaches the model how to do via a prompt section is a candidate for migration into the next model's training data.

The cleanest demonstration: Fable 5 plays Pokémon with no harness#

The June 2026 Fable 5 launch supplies the most legible version of the whole thesis. Earlier Claude models "struggled to play Pokémon FireRed even with harnesses that gave them additional helpful tools" — maps, navigation aids, game-state readouts. Fable 5 beat FireRed with a minimal, vision-only harness: raw game screenshots, nothing else. The scaffolding that compensated for weak spatial/visual reasoning didn't get improved — it got deleted, because the capability moved into the model. The same pattern shows up in Fable's memory results: file-based persistent memory improved Fable's Slay the Spire play 3× more than it improved Opus 4.8's — the model got better at using the harness affordance, so less hand-holding around it is needed. Vision and long-horizon memory are exactly the axes where 2025-era agents needed the most scaffolding; they are now among the first to dissolve.

The wrong direction: harness bloat#

The opposite failure mode is worse than no harness — it actively degrades the model:

• Cat Wu: "What models are capable of in [a one-month] timeline" is the hardest forecast for PMs; over-specifying the harness for an old model wastes tokens that the new model uses better unsupervised.
• Matt Pocock: 250K-token system prompts push the model into the dumb zone before it does anything (see Context Window Smart Zone).
• Repeated capability injections drift toward contradiction: rule X for case A, rule Y for case B, until the model can't tell which applies.

Process: read the system prompt at every launch#

Cat Wu's discipline:

"We read through the entire system prompt and we reflect on, okay, for each of these sections, does the model really need this reminder anymore? And if not, we'll remove it."

This is a backwards practice — most teams would only add to a prompt, not subtract. Doing it on a cadence aligned to model launches is what keeps the harness from accreting.

Build for the next model, not this one#

Counterintuitive corollary from Boris:

"We were trying to build this thing that was like pre-PMF, and we knew that it wouldn't have PMF for 6 months because we were building for the next model."

Most products are built for the model they're released against. Anthropic builds Claude Code for the model six months out — accepting it doesn't quite work today, with the bet that the next release closes the gap. This shifts what "harness work" means: not "make the current model usable" but "build a product surface that will work when the model arrives."

Cat Wu's variant: "It's pretty important to build products that don't necessarily work yet so that you know what is missing for this product to work, and then with the newest model you can just swap it in."

Dan Carey gives the cleanest retrospective case: Claude Design's early-prototype gaps were closed not by clever engineering but by Opus 4.7 shipping ("the model releases are a tide that lifts all boats"). Dedicated treatment, with the next-model-vs-AGI-strawman calibration: Build for the Next Model.

Counterpoint: harness still matters#

Not every voice agrees. Matt Pocock argues the harness — feedback loops, deep modules, mechanical verification — is the ceiling:

"If your code base doesn't have feedback loops, you're never ever ever going to get decent AI decent output out of AI. The quality of your feedback loops influences how good your AI can code, essentially. That is the ceiling."

The synthesis: prompt scaffolding shrinks as models improve; mechanical verification remains essential. Tests, types, linters, isolated review contexts — these are infrastructure that the harness provides and that doesn't migrate into the model the way capabilities do.

Connections#

• Boris Cherny — "100 lines" claim and the spontaneous-loop observation
• Claude Fable 5 — the cleanest demonstration: vision-only Pokémon harness and 3×-better memory utilization vs Opus 4.8
• Cat Wu — the operational discipline of pruning prompts at every launch
• Matt Pocock — counterpoint that mechanical verification stays load-bearing
• Agent Loop Pattern — example of a primitive migrating from harness to model
• Context Window Smart Zone — why prompt bloat is a cost, not just bloat
• Claude Character as Product — character is the rare harness asset that probably doesn't shrink
• Agent Harness Engineering — generalizes the "enforce invariants, not implementations" principle to harness-vs-model division of labor
• Claude Code Auto Mode — a harness feature whose necessity Cat Wu predicts will fade
• AI Brain Fry — partially mitigated by harness shrinkage (less to oversee), reintroduced by output volume from loops
• Human-AI Accountability Redesign — what doesn't shrink is the human at the boundary; this paper names what that boundary work becomes (oversight quality, decision rights, escalation, consequences)
• Model Spec Midtraining (MSM) — alignment moves from harness-prompt-injection of values to model-internalized values; the alignment side of harness shrinkage
• Interaction Models — the same move on the interaction axis: VAD / turn-detection / dialog-management harnesses dissolve into the model (Thinking Machines Lab, May 2026)
• The Bitter Lesson — the underlying principle: hand-crafted scaffolding gets outpaced by scaled general capability
• Build for the Next Model — the product-strategy corollary spun out as its own page: prototype "the thing that almost works" and let the next release close the gap (Dan Carey / Claude Design / Opus 4.7)
• HTML as the New Markdown — the crucial distinction: this page describes the model-facing harness shrinking, while Thariq Shihipar's HTML artifacts (plans, micro-apps) are human-facing harness that grows as models improve (the binding constraint moves from "can the model do it" to "can the human stay in the loop")
• Compute Allocator — names the human role that expands as the model-facing harness shrinks; ~99% of tokens go to human-facing scaffolding
• Founder as Agent Orchestrator — orchestration affordances themselves will shift as harness shrinks; founders building permanent workflows around 2026 Claude-surface affordances should expect rewrites
• Agentic Technical Debt — CLAUDE.md as architectural context is one form of harness; may eventually be inferred by the model, but currently load-bearing
• Compounding Data Moat — vertical-edge-case test suites are a form of harness that doesn't migrate inward (no generic training signal for niche industry edge cases)
• AI-Native Startup Lifecycle — founders building permanent workflows around 2026 Claude-surface affordances should expect them to shift as harness shrinks
• Zero-Friction Scope Creep — written-scope discipline is human-process work that does not migrate inward as harness shrinks
• MCP and Computer Use — complementary to harness shrinkage: connectors don't shrink, they broaden as the model decides which substrate (MCP / API / computer use) to use for each task
• Evals as Product Spec — what doesn't shrink on the PM side: evals are durable artifacts that re-validate the product as the harness around them dissolves
• Agentic Loops Overtake Bespoke Systems — the same dynamic in formal mathematics: DeepMind's bespoke proof-search scaffolding (AlphaProof + evolution) converted from capability-enabling to merely cost-saving as the LLM improved
• Verification as the New Bottleneck — Fiona Fung's org-level corollary: as the generation harness shrinks, verification becomes the binding constraint
• Recursive Self-Improvement — harness shrinkage run to its endpoint: the harness dissolving into the model is the same trend that, applied to AI development itself, closes the self-improvement loop
• AI Accelerating AI Development — the measured deployment-side story: as capability migrates inward, internal engineering throughput rises (~8× code/engineer; >80% Claude-authored)
• Research Taste as the Human Bottleneck — the human-side mirror: what's left after the model-facing harness shrinks is taste, review, and direction-setting
• Vibe Coding vs. Agentic Engineering — Karpathy's ">10x and widening" leverage curve is the practitioner-facing form of shrinking harness / growing capability

Open questions#

• Does all prompt scaffolding eventually migrate into the model, or does some remain — e.g. organization-specific style, security rules, brand voice?
• The Boris "100 lines" prediction is a year out from May 2026 — testable in 2027.
• If harness work shrinks, what new work expands to fill it? Cat Wu's bet: PM/product taste, eval-writing, character work.

Derived#

• Learning to Co-Work with AI: A Software Engineer's Field Guide — pruning-at-every-launch framed as a daily practice; "build for next model" as career-strategic horizon
• Opinions on Using AI Tools & the Future of the Software Engineering Role — the harness-shrinks vs harness-is-the-ceiling tension is one axis of the four-stance debate map
• Does the Human-Facing Harness (HTML Artifacts) Hit Its Own Bloat Ceiling? — the model-facing/human-facing asymmetry taken to its conclusion: the human-facing harness can't shrink to zero and faces more bloat pressure as models improve
• Where Does Agent Harness Work Remain Durable as Models Improve? — separates shrinking capability scaffolding from durable boundary work: verification, repo-local truth, context budgeting, isolation, tools, and human decision surfaces

Sources#

• Anthropic's Boris Cherny: Why Coding Is Solved, and What Comes Next
• How Anthropic's product team moves faster than anyone else | Cat Wu (Head of Product, Claude Code)
• Full Walkthrough: Workflow for AI Coding — Matt Pocock (counterpoint)
• Claude Fable 5 and Claude Mythos 5 — vision-only Pokémon FireRed harness; memory-utilization gains