LeverageAI · The Taste Harness

LeverageAI · Taste can't be briefed, only formed

The Taste Harness

Taste can't be briefed, only formed. How consequential attempts and diagnosed rejections build the context nobody could write down, and the three places that judgment has to live before it can travel.

A skill that makesThe principle, the real example and the words that formed it. It helps the builder decide what to make.
A harness that challengesThe rubric, the truly cold reviewer and the facts code can measure. It catches the quality that didn't survive.
Cases that anchor the wordsThis, not that, with the verdict attached. They stop the principle drifting into a slogan.
A lesson that lives in only one of these is unchecked, untaught or unanchored.

After this book you'll be able to

  • Explain why the best account of a job arrives after the work, and use that on purpose instead of waiting for luck
  • Turn a loose word like "on brand" or "connection" into a definition, an "isn't" and a test a stranger can answer
  • Triage any rejection into the artefact, the instrument that let it through, and the principle it breaks, before fixing anything
  • Carry a lesson in a skill, a harness and contrasting cases, each with the conditions under which it's wrong
  • Work for a client who can't brief you without inventing their business, using a proposed experience they can correct
  • Prove a harvest with a successor test on an unfamiliar case, not with an eloquent essay

Part I · The Oracle Mistake, Refined

The Best Brief Arrives After the Work

At the end of a week of building with AI, on the day I spent making films, I asked the agent supervising the work to explain what the films were for. It explained them better than I could. It also explained them better than the brief I'd supplied before any of it started. This book is my answer to why.

Here's the part that bothered me. I'm not bad at marketing and branding. I'd supplied the original brief myself, generated with AI beforehand from frameworks I've spent years building. That same day, four films later, an AI agent handed me a page that said what the work was for more clearly than my brief had.

I'll show you that page, and exactly what the agent had seen by the time it wrote it, in Chapter 15. For now I want the question, because the whole book hangs off it: why would the explanation of a piece of work get better after the work had been done?

The easy answer is that the model was clever. It wasn't a cleverer model than the one I'd started the day with. It was the same kind of model, running under the same kind of instructions. Something else had changed.

The objection I've been making for years

I've long argued against one particular way of using AI. You'll recognise it, because it's the way most people start.

"I've always argued that you shouldn't use AI as an oracle — tell me the best thing to do, what's the best way to win a customer? Most people would say you need to give it context. That sort of makes sense."

— Me, thinking out loud at the end of that week

I still hold that. Ask a model cold, "What's the best way to win this customer?", and you get a competent, general answer about awareness, trust, differentiation and a clear call to action. Nothing in it is wrong. None of it is yours. It's the answer to the question as anyone would ask it, not as your situation asks it.

The standard fix is the one in the quote: give it context. Load the brand guide, the persona, the offer, the history. That helps, and it's the right instinct as far as it goes. But it isn't what happened with the page.

The agent that wrote the page didn't have a longer brief than the one I'd started with. It had the same brief. What it had in addition was a day of consequences. It had watched films get built and fail review. It had seen two judges score the same cut eight point eight and six. It had heard me reject a voice as "crappy" and watched the fix. So when I asked it "why are we making these films?", it wasn't answering a question about films in general. It had a pile of specific contrasts to account for, and any answer that couldn't account for them was visibly wrong.

Do not expect the best explanation of a task from a system that has only been told about it. Give it access to consequential attempts, then ask it to account for what those attempts revealed.

That's the shape my oracle objection should have had all along. The trouble with the oracle was never only that it lacked context. It lacked contact. A system that has only been told about a task can describe the task. A system that has tried it, watched the attempts fail in specific ways and heard someone say why, can explain what the task is actually for. Chapter 12 unpacks the mechanism properly. Here I only want to put the claim on the table and say plainly that I believe it.

Two products, and only one of them compounds

Once you see the page that way, every round of work looks different. The obvious product of an iteration is the artefact: a better film, a sharper page, a cleaner proposal. There's a second product, and it's the one most pipelines throw away.

Key Insight

A good iteration should produce two things: a better artefact, and a better account of what deserves to be retained.

The artefact gets spent on the job. It ships, or it doesn't, and next week's job starts from zero. The account is the thing the next job could start from: the distinction you didn't have on Monday, the reason a lovely draft was wrong, the test that would have caught it earlier. Most teams keep the first product in a folder and let the second evaporate into chat history. They pay for their taste on every job, and it never compounds.

What I was actually doing that week, though I didn't have the words for it until afterwards, was using production to discover what "good" meant for this work, and then making that discovery operational. I said it at the time in rougher language:

"When we're finished, we've not only got some source code that's an example of what we're doing, we've got an increasingly competitive and accurate test harness. The test harness sort of contains accuracy and validity, obviously — but it's increasingly containing taste."

— Me, the same conversation

That "sort of" was a real hedge, and I'll keep it. A test harness doesn't contain taste the way a person does. What it can contain is a growing set of distinctions that someone's taste produced, each with a way to check it. That's worth more than it sounds, because of the speed at which it was happening:

"That's recursive learning about our current task. I don't think that's all that uncommon — but it's the scale and the completeness and the speed of that cycle, within the videos for one brand. We're escalating how good we are at the thing we're doing, which is nuts."

— Me

What I'm calling a taste harness

This book gives the practice a name, because a practice without a name doesn't get repeated. A taste harness is a way of running production so it forms the judgment nobody could brief, and a way of carrying that judgment so it survives into the next, unfamiliar job.

The book in one line

Triage every rejection before you fix anything; carry what it teaches in three places (a skill that makes, a harness that challenges, and contrasting cases that show what the words mean); and prove the harvest with a successor, not an essay.

Each of those three moving parts has its own chapters. Rejection triage is Chapter 8. The three carriers are Chapter 9. The successor test is Chapter 26. Everything else in the book is either the reasoning that makes them necessary or the evidence that they work.

Where this sits among things I've already written

If you know my earlier work, you'll notice this book arrives next to three ideas that sound related. They are, and the difference matters.

The Taste Kernel, from The Cognition Dimension Ladder, is taste documented: your examples, anti-examples, rejection rules and "too-generic" detectors, applied as the evaluation function a search engine scores against, and kept honest by closing the loop with the real world. Worldview Recursive Compression takes each output, evaluates it, extracts the lesson and encodes it back into one maintained kernel. The Exemplar Ratchet freezes a win, with its cost, and extracts the direction of improvement from blind comparisons against it.

All three need something to hold. A documented taste to score against. An output to evaluate against an existing kernel. A win to freeze. This book is about the stretch before any of those exist: when the standard itself is still being formed, often for a client who couldn't have described it if you'd asked. It's the upstream of all three.

Why this is a problem now

For most of the history of professional work, making things was the expensive part. A film took a crew and weeks. A website took a sprint. A proposal took a partner's weekend. Taste got exercised slowly, a few times per job, by whoever was senior enough to say no.

That's gone. A one-minute film, a site, a thirty-page proposal can now be constructed and revised in hours. When making gets that cheap, the hard part moves. It stops being "can we make this?" and becomes "have we made the right thing?" And at the same time, the harnesses we use to check AI work have become capable of testing fit, not just fonts: whether a voice belongs with its audience, whether a scene connects to what the viewer actually notices, whether an opening assumes knowledge a stranger won't have. When making outruns judging, taste becomes the bottleneck. Chapter 11 takes that seriously, including the ways a harness that judges on taste goes wrong.

How the argument runs

The order of the book is the order in which each idea earns the next. Parts I and II say what taste is, why it can't be written into a brief, and where the missing context actually comes from. Part III builds the harness that forms taste and carries it: the three questions a rejection might be answering, the triage that tells them apart, the three carriers, and the guard against taste hardening into superstition. Part IV explains why the explanation improved, and how to stop a good explanation from promoting itself. Part V is the evidence: one day of films, from that page to a single rejection walked through all three of its lessons, with the before and after of the actual skill text. Part VI takes the hardest case, a client who can't brief you at all. Part VII says what being heard actually requires, and designs the test the whole harvest has to pass. Part VIII is the field kit.

What this book rests on

The evidence is one concentrated week of my own work, recorded in the development sessions for my all-in-one software platform. The films at its centre, and every rejection walked through in Part V, were made in about a day: one-minute films for concept businesses on that platform, and a short series for a small cosmetic-dental clinic. I've generalised the clinic completely: no name, place, people, prices or dates.

The AI judges I name (Opus, Gemini and GLM models) are described as they were configured that week. Anything I report about them is dated and specific to that configuration, not a verdict on a model family.

No film in this book has been measured against a real audience. I claim nothing about how audiences responded. What I do claim is a method, shown working end to end, with the records that contradict the neat version of the story left in.

That's the only time I'll say it. From here on I'll write with the conviction the evidence supports, inside that frame.

So: if the agent that explained the films didn't have more context than I'd given it at the start, what did it have? The answer needs a distinction that most people collapse, between what a system is given and what it discovers. That's the next chapter.

Key Takeaways

  • The best account of what a piece of work is for tends to arrive after consequential attempts, not before them. The oracle's problem wasn't only missing context; it was missing contact.
  • Every iteration makes two products: the artefact, which is spent on the job, and the account of what to keep, which is the only part that compounds.
  • A taste harness forms the judgment nobody could brief and carries it into the next unfamiliar job: triage, three carriers, a successor test.

Part I · The Oracle Mistake, Refined

Context Names What's Available. Perturbation Names How It Discovers What Matters.

Some of what a system knows was handed to it at the start. Some of it could only be found by trying something and meeting resistance. Calling both "context" hides the mechanism that made the explanation better.

Start with a brand brief, read literally. A health clinic wants its films to feel warm, credible, reassuring, recognisably local.

Every word is right. Nobody would argue with any of them. Now watch what they allow.

Warm

…and patronising. A narrator who sounds like she's comforting a child. Warm, tick.

Credible

…and emotionally remote. Polished, measured, expensive-looking, and nothing in it for the person watching. Credible, tick.

Reassuring

…and so flat that nothing registers. Every sentence calm, every sentence forgettable. Reassuring, tick.

Recognisably local

…and a postcard. Landmarks and accents stuck on top of a film that could be about anywhere. Local, tick.

None of those failures contradicts the brief. That's the problem with briefs, and it isn't a problem with this brief. A brief can't tell you where its own words stop. "Warm" doesn't contain the boundary between warm and patronising. Nobody writing it knew exactly where that boundary was, because nobody had seen the patronising version yet.

Where do the edges come from?

You find where the words' edges are by making something and reacting to it. You hear a narrator and something's wrong. "I don't like that voice." At that moment it's a preference, nothing more. But if you stay with it and ask why, it can turn into something more useful: the voice isn't low quality, it puts the speaker in the wrong relationship with the audience. Too much authority for a question the viewer hasn't asked yet. Too far away for a local service.

That's a candidate principle, and it reaches much further than "don't use voice number seven". It could shape casting, wording, pacing, the next brand's film. Provided you check that it actually explains the rejection, and isn't just a plausible story told after the fact. (The real voice rejection from my week was messier than this tidy version, and more instructive for it. Chapter 17 tells it straight.)

The brief supplies concepts. The encounters give those concepts boundaries.

That's why the agent's page in Chapter 1 could be better than my brief without knowing anything my brief didn't mention. It knew where the brief's words stopped, because it had watched them be overstepped.

Context and perturbation

Context names what the system has available. Perturbation names how it discovers what matters.

A pedant will object that everything the supervising agent learned ended up in its context window anyway, so it's all context. Technically, yes. But calling everything "context" hides the mechanism, and the mechanism is the useful part. Some information was supplied at the start. Other information could only be obtained by attempting something and meeting resistance. Those two arrive by different routes, they need different handling, and only one of them is available on day one.

I noticed this before I could say it properly. My first attempt, talking it through at the end of the week, went like this:

"What I've noticed more is that it's perturbation that's almost as interesting as context. Context is perturbation too, obviously. But going over a number of videos and watching the outcomes — the failures, the successes, the rejections — gives the AI more perturbation in the area we're working in. Then you ask it to write an essay about why we're doing these videos and how the marketing and branding works, and it's that much more genius. It's got explicit context, but it's also got perturbation. It's like it's been exercised: it's got more thoughts in the areas we're interested in, it's seen the edge cases. It's helped build its own record of taste."

— Me, at the end of the week

"It's been exercised" is still the best short description I have. An exercised model isn't one with more reading behind it. It's one that has tried to do the thing and been told, specifically, where it went wrong.

I'd already written half of this, about reading

Perturbation isn't a new word in my work. In Cycle Compression I argued that a long conversation with a model that shares hundreds of hours of your vocabulary is "not mainly a sycophancy problem. It is a path dependence problem." Shared context creates conceptual gravity; new observations fall toward the concepts you already have. My answer then was that web research is "not a citations chore. It is an external perturbation source": someone who has never heard of your framework kicks the thought sideways, and "perturbation keeps the breath from becoming a pure sine wave of self-agreement."

That was perturbation by reading. The films showed me perturbation by making. A build that fails review, two judges who disagree about the same cut, a rejection with a reason attached: that's perturbation the work generates for itself, and it's aimed at exactly the part of the problem you're working on. Web research kicks the thought from outside. Consequential attempts kick it from inside the job.

The same extension applies to an argument I made in The Inference Field. Two contexts "can both be 200,000 tokens and be cognitively nothing alike", because of how the tokens got admitted. A context built by retrieval is a pile sorted by resemblance. A context built by walking, where each thing read changes what's worth reading next, is "a causal history of inquiry". Or, as I put it then: "Retrieval spends context on candidates. A traversal spends context on consequences." The supervising agent's context was a travelled argument too. Its steps just weren't all reads. They were constructions, listenings, rejections and repairs.

And I'd seen the design version of this before the films. Co-designing a system with AI a few months earlier, I wrote that "I could not completely explain what I wanted at the start. I had the shape of it", and that "the advances were perturbation, not pure decomposition." Same finding, different medium. There it was a system's shape nobody could specify upfront. Here it's taste.

It isn't just me

The idea that you can't fully specify what "good" means before you've judged some attempts turns up wherever people have looked for it carefully.

Researchers at Berkeley watched people build evaluators for language-model output and named the effect criteria drift: "users need criteria to grade outputs, but grading outputs helps users define criteria". Their conclusion is blunt: "it is impossible to completely determine evaluation criteria prior to human judging of LLM outputs."1 Participants "wanted to add new criteria when they observed new 'types' of bad LLM outputs." They couldn't have listed those types in advance. The outputs taught them.

Donald Schön found the same thing in architecture studios forty years ago. Watching a student designer, he noted that "her intention was not fully established at the beginning of her design process, but evolved through her appreciation of an intermediate design product… An evolving intention is one of the outputs of her designing."2 Software engineering gave it a name that everyone who's shipped to a client recognises: IKIWISI, "I'll Know It When I See It". "Requirements often emerge only after users have had an opportunity to view and provide feedback on models or prototypes."3 And AI-safety researchers at DeepMind put the asymmetry in one line: "It is often easier to evaluate whether an outcome has been achieved than to specify it explicitly."4

Four fields, one pattern. The standard isn't sitting in someone's head waiting to be written down. It forms when attempts meet judgment.

Myth

The model needed more context. Give it the brand guide, the persona and the history and it'll know what good looks like.

Reality

Context is necessary and not sufficient. The distinctions that decide fit arrive as contrast the system can only get by attempting the work.

So does any activity count?

No, and this is the qualifier that keeps "perturbation" from becoming a fancy word for "more activity".

Ten near-identical versions, each greeted with "yeah, looks good", teach almost nothing. The system has been busy. Its understanding hasn't moved. One version that looks excellent and still fails its purpose can expose an entire missing distinction in an afternoon. The difference isn't the amount of disturbance. It's what the disturbance does to the working understanding.

Key Insight

The productive ingredient is not disturbance alone. It is contrast that changes the working understanding.

Education research has a precise version of this. Variation theory holds that "discernment of the critical aspects requires students to experience variation in those aspects", and adds the part people usually forget: "variation is easier to discern when it occurs against a background of non-variance, or sameness… what is not varied is as important as what is varied."5 Ten films that differ in everything teach less than two films that differ in one thing. If you want an attempt to teach you where "warm" ends, change the voice and hold everything else still.

Three signs an attempt was consequential

  1. It could fail the purpose, not just the palette. A version that can only be wrong about colours or fonts can't teach you anything about fit.
  2. Someone said why it failed, in words specific to this artefact. "Not quite" is a reaction. "The craft never connects to anything the viewer notices" is a reason.
  3. The working understanding changed. A distinction, a test or a principle exists afterwards that didn't exist before.

If none of the three holds, the round was activity. It may have improved the artefact. It didn't form any taste.

Which leaves a practical problem. If attempts supply what briefs can't, then every job generates context that didn't exist when it started: distinctions, reasons, tests. What happens to all of that when the job ends? Mostly, it evaporates. The artefact survives. The reasons usually don't.

Key Takeaways

  • A brief supplies the concepts; encounters with real attempts supply their boundaries. "Warm" doesn't contain the line between warm and patronising.
  • Context is what a system is given. Perturbation is how it discovers what matters, by attempting the work and meeting resistance. Keep the words apart; the mechanisms differ.
  • Not every round counts. Perturbation is contrast that changes the working understanding: vary one thing, get a reason, change a distinction.

Part I · The Oracle Mistake, Refined

The Working Process Writes the Missing Context

The context nobody could brief doesn't come from a better brief. It comes out of the work itself. The trouble is that most of it leaves again the moment the work ships.

Suppose you keep everything a film was built from: the source, the assets, the final render. Have you kept what you learned making it?

Most people would say yes. Code is the record; the record is complete. I'd have said the same a year ago. It's the wrong archive, and the reason is worth spelling out, because it decides where the rest of this book puts its effort.

Source code preserves what happened, but it may not preserve why it mattered.

The final cut of a film records the choices that survived. It can't record the alternatives they beat, or why those alternatives lost. The pause before the promise is there in the timeline; the version without the pause, and the reason it felt rushed, isn't. The local narrator is there; the imported-sounding one, and what was wrong with it, isn't. A repository of good outputs is a record of survivors with the causes of death removed.

The why lives upstream of the artefact

I made a version of this argument about software in The Prompt Is Source. "Source", I wrote, is always relative to a compiler stage. Generated code is source to the conventional toolchain, but relative to the agent that wrote it, it's already a downstream product. "Code becomes an intermediate representation only to the extent it can be regenerated from the upstream source package. Until then, parts of it are still the source of truth — whether you admit it or not." And I said where the missing part lives: "Transcripts and prompts are not 'process noise.' They are the source map — code is the what; the transcript is often the why. … When only the generated files remain, you are back to the legacy predicament — with prettier syntax."

Taste decisions are the purest case of that problem. A coding decision often leaves a trace in the code: a guard, a comment, a test. A taste decision usually leaves nothing. The reason a cut shipped lives in a rejection of a different cut, in a sentence somebody said while watching, in a judge's note about something the final version no longer does. Delete the chat, keep the file, and you've deleted the taste. What remains is what I've called trapped judgment: a decision that exists only in the output and the conversation around it, which nobody can regenerate because nobody wrote it down upstream.

Where does the missing context actually come from?

Here is the central claim of the first part of this book, in one sentence.

Key Insight

A well-constructed working process can generate the missing context that nobody knew how to provide upfront.

Not a better brief. Not a smarter model asked a better question. The process. It happens in four steps, and each step can fail in its own way, which is why the book spends the next twenty-five chapters on them.

  1. A first attempt makes some distinctions visible

    No brief can specify every distinction that matters. The first real attempt shows you some of them by getting them wrong. Fails when: the attempt isn't consequential; it can only be wrong about the palette (Chapter 2's three signs).

  2. Recognition and criticism expose others

    A person notices something off. An independent critic points somewhere else. Two judges disagree. Fails when: the reaction comes without a reason, so there's nothing to learn from it (Chapter 8).

  3. Reflection gives the distinctions names

    Someone, often the agent that saw the whole run, states what the attempts revealed. Fails when: the explanation sounds right and isn't, and nobody checks it against a new case (Chapter 14).

  4. Skills and tests make them available next time

    The named distinction goes somewhere durable, in a form the next attempt can use. Fails when: it goes into chat history, or into a longer prompt where nobody can check it (Chapter 9).

The four steps by which a working process writes context no brief contained. Each step's failure mode is where a later chapter picks up.

If you do all four, the process leaves behind something more valuable than any single artefact. My thinking partner put it better than I had: the durable asset "is not just a repository of good videos. It is creative judgment connected to examples, counterexamples and outcomes." For any judged work, swap "videos" for your artefact. The asset is judgment with its cases still attached.

I'd already said the practical version, less elegantly, while it was happening:

"Part of what's going on is we're using the exhaust from the coding process and refactoring it into tests, and into the prompting, and into the skill we're creating."

— Me, at the end of the week

Three destinations: tests, prompting, skill. I didn't know at the time that those three were the whole answer to where a lesson should live. Chapter 9 makes them the three carriers and argues that a lesson needs all three.

The harness is what compounds, and it has to hold more for taste

There's a close cousin of this argument in Replay-Driven Design Evolution. I asked what should still exist if the first build burned down, and answered: "If the answer is 'only some generated code,' the method failed. The durable outputs … are the harness and the history — not the first codebase." Or, more rudely: "Morphing code without a harness is amnesia with a Git log."

That holds for taste, with an extension. A design harness replays candidates against recorded reality and keeps its measures. A taste harness has to hold three things a design race didn't need. It has to hold distinctions with their conditions, because a taste lesson without its condition hardens into a rule it was never meant to be. It has to hold contrasting cases with verdicts attached, because the words alone drift. And it has to hold tests of its own judges, because in taste work the judge is often the thing that's wrong.

Anthropic's own advice on building agent skills lands in the same place from the practitioner side. Iterate with the model, it says; capture its successful approaches and common mistakes into reusable context. "This process will help you discover what context Claude actually needs, instead of trying to anticipate it upfront."6 Discover, not anticipate. That's the working process writing its own context, described by a model vendor.

The first habit: keep what you were told apart from what you learned

If the process is going to write context, you need somewhere to put it that doesn't blur it into the brief. The simplest habit I know is two columns, started on the first day of a job and kept to the last.

Told vs revealed: a running record for any judged job
ItemTold or revealed?Revealed by which attemptConfirmed byWhere it lives now
The audience is local; the service is localTold (the brief)—Client materialBrief
An imported-sounding narrator breaks the relationship with a local audienceRevealedThe first voice cast, rejectedA listening judge named the accent; my ear had only heard "weak"Skill (casting), harness (listening check), a before/after pair
Craft shots must connect to something the viewer noticesRevealedA beautiful first cut, scored 6 by one judgeThe build agent's acceptance of the criticism; three repair roundsSkill, rubric, a before/after pair
An opening must work for someone who has never seen the offerRevealedAn opening I gave six out of tenTruly cold viewers, in some runs, not allJudge brief, skill, rubric

Shape The rows are the week's lessons, abbreviated; each is walked in full in Part V. Use your own job's rows. "Nowhere yet" is a legitimate entry in the last column, and the most useful one to notice.

Two columns sounds trivial. It does three jobs. It stops everything being quietly credited to the brief, or to the AI. It gives rejection triage (Chapter 8) its raw material. And it's the evidence you'll need later when someone, possibly you, tells a neat story about where an idea came from (Chapters 14 and 18).

How would you know the process worked?

One more thing belongs here, because it sets the standard for everything that follows. If a working process generates context, how would you know it actually did? The tempting answer is to look at the account it produces: the page, the principles, the essay. If the account is sharp and persuasive, surely something was learned.

That's the trap Chapter 14 names. An eloquent account can make the previous case sound inevitable without having learned anything that would help with the next one. The only test that can't be fooled that way is a successor: a fresh builder who never saw the process, handed what you kept, set to work on a company it has never seen. Does it refuse the attractive wrong answer? Does it recognise a good one that doesn't look like yours? Chapter 26 designs that test in enough detail to run it. Keep it in mind from here on, because it's what every carrier and every harvest in this book is ultimately answerable to.

Most of the context the process generates is about one thing. Not facts about the client, which the client could have told you. Not technique, which the tools already know. It's about fit: what counts as right for this audience, in this situation, for this purpose. Before we build the harness that forms and carries it, we need to say exactly what that means.

Key Takeaways

  • Artefacts record the choices that survived, not the alternatives they beat. Keep the outputs alone and you've archived survivors with the causes of death removed.
  • The missing context comes from the working process in four steps: attempts, recognition and criticism, named distinctions, and skills and tests. Each step fails differently.
  • Start every judged job with two columns, told versus revealed, and judge any harvest by whether a successor can use it, not by how well it reads.

Part II · What Taste Is

Taste Is Judgment About Fit

Before you can build a harness that forms taste, you have to say what it's testing. Not a palette. Not a preference. Fit, between four things that can each go wrong on their own.

Two sentences. Read them side by side before anything else.

Craft displayed

"Look at the sophistication of our craft."

Craft connected

"Here is how that craft relates to the thing you care about."

Both can be beautiful. Both can use the right colours, the right fonts, the right music. Both can be, in the everyday sense, on brand. Only the second closes a connection with the person watching. The first is about the company. The second is about the viewer, with the company in it.

I'm not inventing that contrast for effect. Two AI judges scored the same film on exactly those two sentences in the week this book comes from; one loved it and one marked it down, and both were right about what they were looking at. Chapter 16 walks it. Here I want the idea underneath it.

Taste

For this work, I define taste as judgment about fit: fit between expression, audience, situation and purpose.

That definition does two things. It makes taste considerably richer than a catalogue of personal aesthetic preferences, which is what most people mean when they say "taste" and then give up on it. And it makes taste testable, because each of the four terms can fail on its own while the other three are fine. That's the property you need if you're going to build anything that checks it.

Four ways to fail, one at a time

The four terms of fit, each with a failure that violates only it
TermWhat it asksA failure that breaks only this
ExpressionIs this the right register for the message?The right message delivered with gravity it hasn't earned: a solemn voice for a light, low-stakes offer.
AudienceIs this right for these people?The right tone for somebody else: an imported-sounding narrator for a local service; vocabulary the viewer doesn't have.
SituationIs this right for the moment they meet it?The right person at the wrong moment: an opening that assumes you've already seen the offer, met cold in a feed.
PurposeDoes it do the job it's for?Everything right except the job: craft displayed when the job was to connect the craft to something the viewer cares about.

Shapes These are the shapes of failure. The real instances, with their records, are in Part V.

Read the table down the third column and you'll notice none of those failures would be caught by a brand-guidelines check. They're all on-palette. They're all "professional". That's the gap this book is about.

Which "on brand" is your harness testing?

"On brand" means two different things, and most brand checks only test one of them.

On brand, the straightforward version

Correct logo, palette, typography and approved wording. Checkable, useful, and shallow. A generic film can pass it perfectly.

On brand, the consequential version

Does this particular experience express this company's promise to this particular audience? Harder to check, and it's the one that decides whether the work does anything.

When I first saw a harness reject a film on the second meaning, I was delighted, and slightly disbelieving:

"We can get a test that rejects because it doesn't match the branding, or doesn't properly match what we're trying to achieve. Have you ever heard of a code harness that's testing on brand? That's just crazy good."

— Me, at the end of the week

"Doesn't properly match what we're trying to achieve" is the consequential meaning. A test that can only say "wrong shade of green" is a linter. A test that can say "this film is about the clinic's craft, and the viewer came here about their own tooth" is doing something closer to what a good creative director does in a review. It isn't a creative director. But it's pointed the same way.

A vendor has noticed too, with limits

Adobe's recent description of its Brand Intelligence product is a strikingly close parallel on part of this. It says the system "learns from what we call 'decision traces', or signals that reflect how teams interpret brands in practice — including comments, edits, rejected versions, and final approvals", and that its validation skill takes in "context from campaign briefs, asset types, and intended audiences" and can "pinpoint exactly where issues occur within an asset and link them back to specific guidelines or prior decisions."7 Its launch post names the problem precisely: brand decisions "are shaped by context, taste, and experience. Guidelines try to capture them, sometimes across hundreds of pages, but they never go far enough."8

That's the vendor's described architecture, not independent evidence that it works. But it matters that a company that size now describes brand validation as learned from rejections rather than written as rules. It says the second meaning of "on brand" is testable enough to build a product around.

Those three limits are where the rest of this book lives. Part III is about routing a rejection to the right place, including the judge. Part VI is about the client with no history to learn from. And the audience question stays honestly open throughout, because nothing about a harness, mine or Adobe's, substitutes for people actually responding.

Why a disagreement between judges is information

In The Exemplar Ratchet I split the criteria for judging a page into three families with different owners. Craft: the visual and verbal making. Doctrine: whether the page carries the company's actual commitments. Care: whether the experience is safe, true and non-manipulative. And I wrote that "a page has to win across families, not average them into mush."

The two sentences at the top of this chapter are a craft-versus-doctrine disagreement. The first scores beautifully on craft. The second is what doctrine asks for. A harness that averages its judges would pass the beautiful film, because one high score and one middling score average out to "good". A harness that knows the families can see what actually happened: craft won and doctrine lost. That's not a tie to be split. It's a finding.

How far can a harness go?

Not all the way, and I want to be exact about where the line is, because I drew it myself in an earlier book and I'm now moving it.

In Hidden Gates I wrote that hidden gates "guard completeness and process … They do not guard taste." Taste, I said, isn't a checklist a worker could game; it's the thing you were trying to protect. "Removing yourself from the inner loop is the design goal; removing yourself from the judgement of quality-as-such is drift."

The films moved that line, but only partly. A harness can now operationalise some failures of fit as inspectable tests. Does the craft connect to something the viewer notices? Is the voice cast from the audience's place? Does the opening assume knowledge a stranger won't have? Each of those can be asked of a film, by a judge or a cold viewer, and answered with a time and a reason. What a harness still can't do is decide that something is good. Promotion to "this is the standard now" stays with a person.

Bottom Line

A harness can be a repeatable, inspectable way to detect certain failures of fit. It is not an infallible taste oracle, and it shouldn't be built as one.

Anthropic's write-up of its own design harness arrives at the same boundary from the other side. "Aesthetics can't be fully reduced to a score — and individual tastes will always vary," its author writes, "but they can be improved with grading criteria that encode design principles and preferences. 'Is this design beautiful?' is hard to answer consistently, but 'does this follow our principles for good design?' gives Claude something concrete to grade against."9 Swap "beautiful" for "on brand" and you have the move this book makes.

Why fit is testable at all

There's a reason this works, and it's worth knowing because it tells you what a good test looks like. Experts don't usually decide things by reciting rules. They recognise. Kahneman and Klein, who disagree about a lot, agree on Herbert Simon's definition: "The situation has provided a cue: This cue has given the expert access to information stored in memory, and the information provides the answer. Intuition is nothing more and nothing less than recognition." And crucially: "valid cues must be specifiable, at least in principle — even if the individual does not know what they are."10

That's the whole trick. When I rejected a voice as "crappy compared to the rest, seems like older tech or something", I was responding to a cue I couldn't name; "or something" is the tell. A judge that could actually listen named it later: an incongruous British accent (Chapter 17 has the whole story). Once a cue has a name, it can become a test. Making taste testable is mostly the work of finding the cue a person is responding to and writing it down in a form someone else can check.

Which raises the question the next chapter answers. If the cue can't be written down in advance, if even the person responding to it can't name it, where does the named version come from? It isn't copied out of anyone's head. It gets made.

Key Takeaways

  • Taste, for this work, is judgment about fit between expression, audience, situation and purpose. Each term can fail on its own, which is what makes it testable.
  • "On brand" has a shallow meaning (palette, logo, wording) and a consequential one (this experience expresses this promise to this audience). Know which one your harness tests.
  • A harness can detect certain failures of fit and say where. It isn't a taste oracle, and promotion stays with a person.

Part II · What Taste Is

Formation, Not Transfer

"Capture the expert's taste" assumes the taste is already in someone's head, finished, waiting to be written down. Some of it is. A lot of it gets made in the work, between the person and the machine, and didn't exist before either of them started.

"See how we did that." It's what a master says to an apprentice with a hand on their shoulder, standing in front of something that went right.

I found myself saying a version of it to an AI that week, without noticing I was doing it. When I described the method afterwards, it came out like this:

"I'm using more of the 'see how we did that' strategy with the AI. Get it to help me make one video first — do the research, find the tools — let me review it by hand a few times and explain what I found. Then it's building better code, and it's building its own test harness as we go. I explain what I found in the video, and it updates the test harness."

— Me, at the end of the week

The question is what exactly you take away when you "see how we did that". Because there are two very different things on offer, and most people grab the wrong one.

Two things you can extract from a session that went well

A sequence

Use these tools. Write this script. Generate this narration. Render these scenes.

Reproduces the procedure. Works again on a job shaped exactly like this one.

A body of judgment

What were we trying to achieve? Which apparently reasonable choices failed? What did the human notice? Which correction improved the outcome? Under what conditions should that lesson apply again?

Supports competent variation. Works on a job that isn't shaped like this one.

The first is a recipe. The second is what an apprentice actually takes away from a good master, and it's why apprenticeship works for skills that recipes can't carry.

The first reproduces a procedure. The second can support competent variation.

The sequence is easy to extract and nearly useless on the next client, because the next client's film won't want the same scenes. The body of judgment is hard to extract, and it's the only part that travels.

Why the rejected versions matter more than the final one

Here's the part people miss. The final artefact contains the choices that survived. It cannot, by itself, explain the alternatives they defeated. If you only keep the winner, you've kept the answer and thrown away the question it was answering. The production history supplies the missing contrast: this voice rather than that one, this opening rather than the one that assumed too much.

Learning science has known this for a long time. Schwartz and Bransford ran studies where students analysed contrasting cases before being taught the underlying idea, and found that "noticing the distinctions between contrasting cases creates a 'time for telling'; learners are prepared to be told the significance of the distinctions they have discovered."11 Both halves mattered. Contrasts without an explanation didn't get students to the principle. An explanation without the contrasts didn't stick. The contrasts first, then the telling, beat either alone. Hold on to that order: it's also why the supervising agent's explanation in Chapter 1 landed after the work.

The cognitive-apprenticeship literature says it about skills directly. Some concepts can be formally described, "but many of the crucial subtleties of their meaning are best acquired through applying them in a variety of problem situations. Indeed, it is only through encountering them in real problem solving that most students will learn the boundary conditions and entailments of much of their domain knowledge."12 And the same paper describes the move that turns tacit into usable: "By becoming critics as well as producers, students are forced to articulate their knowledge … once articulated, this knowledge can no longer simply reside in tacit form." Producer and critic. Hold that pair in mind for Part III, where it becomes a skill and a harness.

After the task, or while doing it?

I've written about extracting lessons from work before. In Worldview Recursive Compression the loop is generate, evaluate, extract, encode: after each output, you judge it, pull out the lesson and put it back into one maintained kernel of your judgment, so "the lesson goes back into frameworks.md, not just into the output." Fix the kernel, not the output, and the lesson helps forever.

That's still right. But it describes extraction after each output, from a worldview that already exists. What happened with the films was earlier and messier than that.

You are not only extracting knowledge after the task. You are developing the knowledge needed to complete the task, while completing it.

And the knowledge doesn't go back into one kernel. As Part III argues, it goes to three places that do different jobs.

There's an older cousin of this in A Blueprint for Future Software Teams, where I described mining AI coding conversations for repeated corrections and rationale, "giving your system dream time", and turning them into rules. The same chapter carries a warning I still stand by: "AI may misunderstand context, over-generalize from specific cases, or miss nuance. … Treat AI extraction as proposals, not decisions." That mining happens after the fact, over conversations that weren't set up to teach anything. "See how we did that" is different in kind: it's during the work, and the contrast is made on purpose. Keep the warning, though. It comes back in Chapter 11 as the superstition trap.

Where does the principle come from, if nobody had it?

This is the part I didn't expect. I'd assumed the process was taste transfer: my judgment, moved into the system. Some of it was. I had opinions before the session started. But some of the distinctions that ended up in the skill weren't in my head at the start in any form I could have written down. They became clear through the collaboration.

  1. I recognise something wrong. No words for it yet. "Not that."
  2. The model proposes an explanation. A candidate reason, in words I can accept, refuse or adjust.
  3. A changed version gives me something sharper to judge. Better, but now I can see what else is off.
  4. My recognition sharpens. The reason gets more precise; so does my sense of the boundary.
  5. A distinction exists that neither of us held when we started.
Taste formation, in five moves. The distinction at the end wasn't transferred from anywhere. It was made in the loop.

Neither party necessarily possessed the fully articulated principle at the beginning. That's the important sentence. It means "capture my taste" is only half the story.

Key Insight

That is taste formation as well as taste transfer.

I'd already named the middle step in Demonstrate Over Tell, where I called it assisted articulation. When someone rejects something, "the person may not have a fully formed explanation waiting to be recalled. They may only have a reaction. The machine supplies candidate interpretations of that reaction … and the person recognises, combines or corrects them." I added a guard: "The proposed reasons should help people find their meaning, not quietly replace it with the model's framing." In taste formation, that step does more than help me say what I meant. Sometimes it's where the meaning first gets made. The guard matters more, not less.

None of this would surprise a design researcher. Schön wrote that design knowledge "is knowing in action, revealed in and by actual designing. It is mainly tacit … designers know more than they can say, they tend to give inaccurate descriptions of what they know, and they can best (or only) gain access to their knowledge in action by putting themselves into the mode of doing."2 It's Polanyi's old line, "we can know more than we can tell", with a practical consequence attached.13 If you can best reach your judgment by doing, then the doing has to be set up to catch it.

It also explains a gap in one of my own frameworks. The Exemplar Ratchet freezes a win and extracts its direction of improvement. It needs a win to freeze. Formation is what happens before there's any win at all, while you still don't know what "good" is for this audience.

What to keep from an apprenticeship session

  • The rejected versions, not just the final one. They carry the contrast.
  • The words used to reject them, verbatim. "Crappy, sounds like older tech" is data. "Revised for quality" isn't.
  • The candidate explanations the model offered, and which one you accepted, refused or adjusted.
  • The changed version that settled it, side by side with what it replaced.
  • The condition under which the lesson should apply again, even if it's only a guess.

That list is the raw material for everything in Part III. But formation leaves one particular residue before any of it: short phrases. "Wow." "You see me." Words that carry far more than they say, and that are worth almost nothing until they've been made precise.

Key Takeaways

  • "See how we did that" is an apprenticeship instruction. Extract the body of judgment, not the sequence; only the judgment supports variation.
  • The rejected versions carry the contrast the final can't. Keep them, with the words that rejected them.
  • Some taste is transferred from a head. Some is formed in the loop between a person's recognition and the model's candidate explanations. Set the work up to catch both.

Part II · What Taste Is

The Handle and the Discrimination

Every team that makes judged work runs on a handful of short phrases. They're how taste gets steered in a hurry. They're also where it quietly goes missing, unless each one points at something specific enough to test.

I had three phrases I kept using that week. "Wow." "Oh, you see me." "Let the promise land."

They'd gone into the prompting early, because that's how I talk about what a film should do. Builders were steering by them. And partway through, I realised I didn't know exactly what they meant, which meant nobody else did either. So I asked the build agent to fix that:

"Can we better explain some terms I used loosely earlier, that got recorded in the prompting — like 'aha moment' and 'you see me'? We can probably make them more accurate without being overly verbose. That might feed into the test harness as well."

— Me, to the build agent, near the end of the week

Where the answer came from, and what else came with it, is in Chapter 18. This chapter is about what those phrases are worth, and what they need before they're worth anything.

What's a short phrase actually for?

Short phrases are powerful. "Let the promise land" lets me steer a two-minute sequence of decisions with four words. A director can say "more air" and a whole crew knows what to do. That's the upside, and it's real.

The downside is that a short phrase only works when it points into something: a set of worked examples, contrasts, "this, not that". Without that grounding it's just an adjective with ambitions. Hand "wow" to two builders and you get two unrelated films, one full of spectacle and one full of a clever reveal, and both of them can claim they delivered wow. Adjectives in a brief are where fit goes to die, because every failure complies with them.

The short phrase is the handle. The accumulated discrimination is the asset.

My thinking partner's first pass at mapping the handles to what they should mean was already a big improvement on the words alone:

Three handles, and the distinction each should invoke
HandleThe distinction it should invoke
"Oh, you see me."The viewer recognises their own situation, rather than merely being told the company understands them.
"Wow."The demonstration reveals a valuable possibility, not simply an impressive production effect.
"Let the promise land."The viewer has enough space to connect the demonstrated value to the company's commitment.

And one sharpening of "wow" that I've kept ever since: the valuable wow is not merely "that looked expensive". It's "that understands my situation — and now I see what this would do for me." The spectacle has to carry the promise, not compete with it. A film can be gorgeous and have no wow at all in that sense. A plain film can have plenty.

The four terms, made precise

The version that actually went into the skill and the harness went further. Each handle became a term with three parts: what it is, what it isn't, and a test someone other than me can run.

Four terms made precise, each with the near miss it isn't and a test
TermWhat it isWhat it isn'tThe test
Recognition
my "I see you"
In the first few seconds, a specific detail from the viewer's own life, shown not described: a habit, an artefact they handle, words they'd use. They think "that's me" before they know what's being sold. A generic smiling person, narration claiming empathy, or a statement of the problem. The viewer can name the detail, and it's specific enough that someone outside the audience wouldn't recognise it.
Being heard
"the stronger form we found"
The person's own words come back inside the service's response. Their words repeated back without anything changing because of them. "Where did the person's words change what happened?" The viewer can point to the moment.
Aha
my "wow" and "aha moment"
The moment the viewer works out the mechanism for themselves. It happens where the person's situation and the product meet in one frame. A surprising visual, a twist, or a benefit claim. The viewer names the moment and restates how it works in their own words, with a detail from the film. "If they can only repeat the narrator's claim, it was told, not demonstrated."
Demonstrate
sharpened
A change the viewer watches: before, the service acts, after. "A tool posed beside a finished result is a still life." Something visibly changes on screen because the service acted.

Definitions and tests as they were written into the brand-film skill and its judge that week, lightly trimmed; the "isn't" for being heard is my wording of the distinction Chapter 24 develops.

Reading the table, not just looking at it

Three things about that table are worth more than any row of it.

The middle column does most of the work. Every term has a near miss, and the near miss is exactly the attractive wrong answer a builder would otherwise produce. Ask for recognition without saying what it isn't, and you get a smiling stock person and a narrator saying "we understand". Ask for demonstration without the still-life clause, and you get a beautiful tool beside a beautiful result, with nothing happening. The "isn't" is where the taste lives, because it's where the rejections came from.

One row wasn't in my vocabulary at all. I'd never said "being heard". It turned up during the work as a stronger form of recognition: being recognised is seeing your situation on screen; being heard is seeing your own words change what the service does. Nobody briefed it. It's formation, from Chapter 5, leaving a trace in the dictionary. It became the most important idea in the whole series, and Part VII is built on it.

Every test is a question a stranger can answer. None of them is "does this feel right to Scott?" They're phrased so a cold viewer, human or model, can be asked them and their answer checked. That's what lets the same distinction live in two places, telling a builder what to make and telling a reviewer what to look for. Chapter 10 is about why that double life matters.

Where the Taste Kernel came from

In The Cognition Dimension Ladder I argued that the real moat in AI-assisted decisions isn't the engine; it's the evaluation function the engine scores against. "Taste is not just human magic. You compress it into examples, anti-examples, rules, rejected patterns, preferred language — and then you apply it systematically." I called that documented judgment the Taste Kernel, and said it stays honest only by closing the loop with the real world.

That describes taste once it's documented. The four-term table shows how a kernel entry gets made. It starts as a loose handle. Rejections sharpen it into a definition. The near misses become its anti-examples. A test gets attached that can fail. The Taste Harness is the Kernel's missing upstream: the place where entries are formed before they're filed.

Why "wow" alone is a slogan

There's a test I wrote for design patterns in Generative Design Patterns that applies directly here. Give only the phrase to two independent builders. Do their results share a recognisable invariant and differ mainly in local fit? Then it's a pattern. If they share only a buzzword, it's a slogan. "If independent expansions share structure, it is a pattern. Heat without invariant is fashion." And the fix I proposed then is the fix now: "Do not rescue a slogan by adding adjectives … Add invariant structure … or admit you are still naming a desire."

"Wow" handed to two builders is a slogan. "Aha, with this test" is a pattern: two builders will make different films, and a third party could still say what both were trying to do. The structure that turns one into the other is always the same three parts: definition, near miss, test.

And the reason it works goes back to Chapter 4. Expert judgment runs on recognition of cues the expert often can't name. A test is a cue that someone finally named.

Handle to test, in four lines

  1. The handle, as people actually say it. Don't clean it up.
  2. What a viewer would see, hear or be able to say if it worked. Observable, not felt.
  3. What it isn't: the near miss that looks like it. This is usually the version you last rejected.
  4. The test, and who runs it: the builder's self-check, a judge, a cold viewer, or a person.

Illustrative "Premium" → the viewer can say what they'd get here that they wouldn't get elsewhere → it isn't expensive-looking imagery any competitor could run → hide the logo; can a stranger name one thing only this company has? (Chapter 22 is built on that last test.)

Takeaway

A handle made precise is a distinction you can test: a definition, the near miss it isn't, and a question a stranger can answer.

Once a distinction can be tested, it can fail a test. And the moment something fails, the harness has to answer a question most loops never ask: what, exactly, failed? The thing we made, the way we checked it, or the distinction itself?

Key Takeaways

  • Short phrases steer fast and mean nothing on their own. The phrase is the handle; the discrimination behind it is the asset.
  • Make each handle a term with three parts: what it is, what it isn't, and a test a stranger can answer. The "isn't" is where the taste lives.
  • Some terms won't be in your vocabulary until the work produces them. "Being heard" arrived that way, and became the book's central idea.

Part III · The Harness

Three Questions of Improvement

"Just run the loop again" hides a choice. When something fails and you go round again, which thing are you trying to improve? Most loops never say, and so they only ever improve one of the three.

Every AI workflow I've seen has a loop in it somewhere. Make something, check it, fix it, check it again. It's the most useful pattern in the field, and it has a blind spot built into its grammar.

The blind spot is the word "it". Fix it. Check it. The loop assumes there's one thing being improved: the output. But when a piece of judged work fails, there are three different things that might need to get better, and they answer three different questions.

MAKE · THE ARTEFACTCan we make it better?This changes the artefact and the production method: the film, the page, the proposal, and how it's built.
TELL · THE INSTRUMENTCan we tell more reliably whether it's better?This changes the observations, comparisons and evaluator: what we check, how, and who (or what) does the checking.
SAY · THE PRINCIPLECan we say more precisely what "better" means here?This changes the skill's understanding of purpose, audience and appropriate expression.
The three questions of improvement. A loop that asks only the first improves the artefact and nothing else.

I'll call these the three questions of improvement. (Readers of A Blueprint for Future Software Teams will remember a different set of three questions, about sticking points, surprises and never-agains, for extracting a lesson at the end of a ticket. Those are for pulling a lesson out. These are for locating which thing a lesson improves. Both are useful; they do different jobs.)

Each question has its own product, owner and evidence

The reason to separate them is practical. Each one produces something different, can only be answered by particular people, and has its own evidence that it worked.

What each question produces, who can answer it, and how you'd know it worked
QuestionWhat it producesWho can answer itEvidence it worked
MakeA better artefactThe builder, given the rejector's own wordsThe next version passes for the reason given, not just passes
TellA better instrument: a judge brief, a rubric line, a viewer persona, a measured fact, or the builder's own self-checkWhoever owns the harnessThe revised instrument catches the failure on the old version and passes the fixed one. Keep the old version; it's now a test fixture you can re-run.
SayA stated distinction, with the condition under which it holdsThe person whose judgment is being formed, working with the supervisor's candidate explanationThe distinction changes a decision on a different artefact. At scale, that's the successor test in Chapter 26.

Look at the last column. Only the first row's evidence is visible on the day. The other two only show up later: when the old failure is re-run against the new judge, or when a different job goes differently because of a principle. That's exactly why most loops skip them.

Why most loops only ask the first question

The artefact is visible, urgent and billable. The client is waiting for the film. The instrument and the principle are invisible until they fail again, usually on a different job, usually when someone else is doing it.

But look at what each one is worth afterwards. The artefact is spent on this job. The instrument and the principle carry to the next one. A loop that only asks "make" pays for taste on every job and never compounds. Chapter 1 said every iteration makes two products, the artefact and the account of what to keep. This is what the account is made of: a better way to tell, and a more precise thing to say.

That's also why the speed of these loops matters so much now. When a cycle runs in hours inside one job, you can ask all three questions several times before the job is done. The escalation I described in Chapter 1, getting better at the thing while doing the thing, comes from the second and third questions, not the first.

One rejection can move through all three

Here's where it gets interesting. A single failure doesn't have to belong to one question. It can travel.

Take a voice rejection, in its tidy form. At first it looks like a production defect: replace the voice. Then it exposes a perception defect: the judge was assessing the narration from a transcript, so it couldn't hear the quality being criticised. Then, if you keep going, it exposes a gap in the principle: the skill never distinguished the narrator's role from the customer's voice, or said what relationship each one should establish with the audience.

One rejection can improve the product, the instrument and the principle.

That's the tidy version. The real voice rejection from my week was messier, spread across four separate events in one long day, and I'll tell it straight in Chapter 17. The cleanest real case, with the actual skill text before and after, is Chapter 19. For now the claim is the important thing: if you stop at the first question, you get a better film and keep the blind judge and the missing principle. The next film fails the same way, and so does the next client's.

"Isn't this just iteration?"

It's the obvious objection, and it deserves a straight answer, because it's half right. Yes, it's a loop. No, it isn't the same loop.

A loop driven by a score, pass or fail, seven out of ten, can only move the artefact. A number carries no information about whether the judge could see the problem, or whether anyone knows what "better" means here. It tells the builder to try again, and nothing else. A loop driven by diagnosis in words can move all three, because a reason can be about the artefact, about the instrument, or about the principle.

The research has caught up with this. GEPA, a prompt optimiser from a group of university and industry researchers, argues that "the interpretable nature of language often provides a much richer learning medium for LLMs, compared to policy gradients derived from sparse, scalar rewards." It reflects on what happened in each attempt "to diagnose problems, propose and test prompt updates", and it distinguishes two kinds of trace. The text the system produced is the execution trace. The text the environment produced while evaluating it is the evaluation trace: "Beyond reflection on execution traces, we identify a second valuable source of diagnostic information in the evaluation traces."14 Execution trace and evaluation trace: that's the artefact and the instrument, in a paper about prompt optimisation.

Work on reward models points the same way. Training a judge on binary verdicts makes it "susceptible to guessing correct outcomes without sound critiques", which puts noise into everything learned from it.15 An earlier study concluded that "judgments hold greater potential than rewards" for aligning models.16 In plain English: a "no" without a reason lets the judge be right for the wrong reason, and gives you nothing to route. A "no, because…" can be sent to whichever of the three questions it belongs to.

Myth

Iterate until it passes. When the judge says yes, you're done.

Reality

A pass tells you nothing about whether the judge could see the failure you were worried about. Passing is evidence about the artefact and the judge together.

What this adds to an older loop of mine

In Worldview Recursive Compression I wrote that "when you generate a good output, it validates your framework. When you generate a bad output, you learn what's missing." Still true. But "what's missing" now has three possible addresses. It might be missing from the artefact. It might be missing from the way we checked it. It might be missing from what we think "good" means.

The second address is the one that loop assumed away. Its evaluate step treated evaluation as reliable: you look at the output and you can tell whether it's good. In taste work that's often exactly what fails. The judge was reading a transcript. The "cold" viewer had been told it had already seen the ads. The brief told the reviewer where the film would be shown, and the reviewer forgave it accordingly. A bad output that exposes a blind judge teaches you something no amount of fixing the output would.

Key Insight

Ask all three questions every time something fails. The artefact is spent on this job; the instrument and the principle are what the next job starts from.

Knowing there are three questions doesn't tell you which one a particular rejection belongs to. A reviewer's "no" arrives as a single word, or a single sentence, and it doesn't come labelled. Sorting it takes a deliberate step before anyone touches the artefact. That step has a name.

Key Takeaways

  • When judged work fails, three things might need improving: the artefact (make), the instrument (tell) and the principle (say).
  • Each has its own product, owner and evidence. Only the artefact's evidence is visible on the day, which is why loops skip the other two.
  • Scores can only move the artefact. Reasons can move all three. A single rejection can travel through every leg if you let it.

Part III · The Harness

Rejection Triage

A rejection arrives unlabelled. Before anyone fixes anything, ask what it's evidence of: the thing we made, the way we checked it, or what we meant by good. Get the order wrong and you destroy the evidence.

The step is triage, and I didn't invent the idea of routing a rejection. I wrote the first version years before these films, and it's still right as far as it goes.

In Look Mum No Hands, writing about AI proposals that people approve or reject, I said: "Rejection isn't failure—it's feedback. And how you capture rejection feedback determines whether the system learns." Different rejections point to different fixes. "Wrong person" is a data problem: the underlying record is wrong. "Wrong action" is a playbook problem: the decision rules need updating. "Wrong timing" is a context problem. "Wrong tone" is a template problem. And the principle that holds them together: "feed back at the right layer. If the playbook is wrong, fix the playbook—don't just reject this one card and leave the playbook broken."

I reused it in Demonstrate Over Tell, where a menu of candidate reasons makes the routing almost automatic, because each reason can carry its layer with it.

What the old routing quietly assumes

Read those four layers again. Data, playbook, context, template. Every one of them is about how the artefact got made: what it was made from, what rules made it, what it knew, how it was worded. The routing assumes two things it never says out loud. It assumes the person who said "no" saw correctly. And it assumes everyone already knows what "right" would have looked like.

For operational proposals, those are usually safe assumptions. For taste work they're the two that break first. The judge often can't see the problem, or has been pointed at the wrong viewer. And "right" is frequently the thing nobody could say yet. So the routing needs two more layers.

Routing a rejection: the original four layers, plus the two that taste work needs
LayerWhat the rejection implicatesTypical fix
DataWhat it was made from was wrongFix the source material
Playbook or briefThe rules for what to make were wrongFix the rules
ContextIt didn't know something about the situationSupply what was missing
Template or styleHow it was expressed was wrongFix the expression
InstrumentThe thing that tells us whether it's good couldn't see the problem, or was pointed at the wrong viewer: a judge brief, a rubric line, a viewer persona, a measured fact, the builder's own audition methodVersion the instrument; keep the failing artefact as a fixture
PrincipleWe couldn't yet say what "better" meant here, or the skill already says something that caused thisState the distinction, with its condition; fix the skill text that caused it

The first four are all answers to "make". The last two are "tell" and "say", from the previous chapter. Triage is simply asking which row a rejection belongs to, and allowing the answer to be more than one row.

What does this failure teach us: a defect in the film, a defect in our perception, or an incomplete account of what we want?

That question, which came out of my conversation with the thinking partner after the week, is the whole of triage. Swap "film" for whatever you make. Ask it before anything else happens.

Why triage has to come before the fix

This is the rule people break most, because the fix is right there and the client is waiting.

Pitfall: fixing first

Fix the artefact before you triage, and you destroy the evidence that the instrument missed it. The failing version is gone; you can no longer run your current judge on it and see whether the judge would have caught the problem. You'll never know whether the harness was blind, so it stays blind.

The order is: record the rejection verbatim, keep the failing version, run the current judge on it, triage, then fix. The failing version becomes a test fixture for the instrument leg. It's the only way to check that a revised judge now sees what it didn't.

How do you tell which leg it is?

Each leg has its own diagnostic questions. Run all three sets; more than one can come back yes.

Artefact

Did the builder have what it needed, and still miss?

If you handed the rejector's exact words to the builder, would that alone fix it?

Instrument

Would our current judge have caught this?

What was it told about the viewer, and about where the work will be seen?

What was it fed: a transcript, frames, sound, measured facts?

Did the builder's own self-check measure this at all?

Principle

Can anyone state the distinction this points to, in one sentence, with a condition?

Does the skill already say something that produced this failure?

What does the rejection protect?

That last question is the best tool I have for the principle leg, and I borrowed it from my own work on relationship files. In The Manila Folder, writing about offering people candidate labels for themselves, I noticed that "'That isn't me' is easier to say than 'this is me,' and it points the same way", and gave one instruction: "When they reject one, ask what the rejection protects. That sentence often belongs in the retelling."

Apply it to taste. "I don't like that voice." What does the refusal protect? Not "good audio", which is what it sounds like. It protects the relationship between the speaker and the audience: whose voice this is meant to be, where it's coming from, how close it stands. That sentence is the candidate principle. Sometimes the rejector can say it directly if you ask. Usually the model can propose it, and the rejector recognises it or refuses it (Chapter 5's formation loop, doing its job).

The instrument leg is a learning event

I want to be careful about the instrument leg, because there's a whole book's worth of argument about why AI judges miss what they miss: what they can perceive, what they're fed, how to measure their range. That's the sibling book, Code as Proxy, and I won't re-argue it here. For triage, the instrument leg asks a narrower question: what did this rejection teach us about how we tell?

The answer is often surprisingly mundane. It isn't always the model. It's the brief the judge was given, which mentioned where the work would be shown. It's the persona the "cold" viewer was handed, which gave away the answer. It's the builder's own habit of auditioning voices by whether the transcript comes out clean, which can't hear quality at all. Those are instruments too, and they're the ones people forget to suspect.

The discipline for this leg is one I wrote down in Your AI Partner Is the Challenger: "If a failure reveals that your scoreboard cannot see the real defect, that is not only a design loss — it is a measure discovery. Record the date and the motivating case." Version the evaluator. Keep the case that taught you.

The triage card

Here's the artefact. It's the most-used form in the book, and every lesson in Part V passes through one.

Rejection triage card

The rejectionIn the rejector's own words, verbatim. Not paraphrased, not tidied.
The artefactWhich piece, which version. Keep it; it's now a fixture.
Leg(s)Artefact · instrument · principle. More than one allowed.
Instrument detailWhich instrument; what it was told; what it was fed; what it said about the failing version.
Principle detailThe candidate distinction, with its condition ("when the audience is local…"), and what the rejection protects.
Routes toSkill · harness · contrasting case (Chapter 9). Often more than one.
The test, per legWhat would show the fix worked: the new version passes for the stated reason; the revised judge catches the old version; the principle changes a decision elsewhere.
Reopen ifWhat would make us revisit this.
Date · accepted byWhen, and who agreed the routing.

And one card filled in, from outside the films, so it's usable before you've read Part V.

Illustrative A proposal rejected as "too salesy"

  • The rejection: "This reads like we're trying to upsell them. They told us budget was tight."
  • Artefact leg: the draft recommends the larger package in its first paragraph.
  • Instrument leg: our review checklist scores completeness and structure. Nothing on it asks whether the recommendation respects a constraint the buyer stated, so the draft scored well.
  • Principle leg: "Recommend the option that fits the buyer's stated constraint first; present the larger option as an alternative, not the default." Condition: when the buyer has named a constraint. What the rejection protects: the buyer's sense that we heard them.
  • Routes to: a skill line with this proposal as the example and the reviewer's words; a checklist question ("Which stated constraint shaped the recommendation?"); a before/after pair of opening paragraphs.
  • Tests: the redraft opens on the constrained option; the revised checklist flags the original draft; the next proposal for a constrained buyer goes the same way without being told.
  • Reopen if: buyers with stated constraints consistently choose the larger option anyway.

Triage locates. It doesn't promote.

One guard, before the next chapter gives lessons their homes. A principle that comes out of a single rejection is a candidate. In Demonstrate Over Tell I put it this way: "A picked reason is evidence about this moment, not a permanent preference. … Don't promote a single situational rejection into a rule about the person." Triage tells you where a lesson belongs. It doesn't tell you the lesson is true everywhere. Chapter 11 is about what happens when that distinction gets lost.

The messiest real three-leg case from my week, a voice, is in Chapter 17. The cleanest, with the skill text and the judge's questions before and after, is Chapter 19.

Remember

Record the rejection verbatim, keep the failing version, and ask which of the three it's evidence of, before anyone fixes anything.

Triage tells you where a lesson belongs. It doesn't give the lesson anywhere to live. The default home, a new line in the prompt, is the wrong one, and the next chapter explains why it takes three.

Key Takeaways

  • The classic routing (data, playbook, context, template) covers how the artefact was made. Taste work needs two more layers: the instrument that failed to see, and the principle nobody had stated.
  • Triage before you fix. The failing version is the only evidence that the judge was blind, and the fixture for proving it no longer is.
  • For the principle leg, ask what the rejection protects. That sentence is usually the candidate principle, and it arrives as a candidate, not a rule.

Part III · The Harness

Three Carriers That Must Reinforce Without Converging

A triaged lesson needs somewhere to live. Not one place: three, each doing a job the other two can't. And the three have to agree without becoming copies of each other.

Picture what happens to a prompt after twenty rejections have been "harvested" into it.

It's two pages long. It opens with a sensible paragraph about purpose and audience, then turns into a list: always do this, never do that, make sure you, avoid. Half the lines were written in a hurry after a single bad afternoon. A few contradict each other. The builder that reads it has become timid; its output is safer and blander than it was at the start. And not one of those twenty lessons can be checked, because a line in a prompt is an instruction, not a test. Longer prompt, weaker lessons.

I'd already learned this the hard way, on websites, before the films started. When the build agent drafted its list of lessons for the general skill, it reminded me of my own earlier finding in one line: "prescriptive rules made results worse." Its proposal was the opposite of a rulebook: each lesson as "the principle, why, and a test, not rules."

The three carriers

The skillCarries the productive principles, with the real example and the words that formed them. It helps the builder decide what to make.
The harnessChallenges whether those principles survived execution: the judges' rubric, the cold viewer's questions, the facts code can measure. It recognises when the intended quality didn't make it.
The contrasting casesShow what the principles mean and where they fail: this, not that, with the verdict attached. They stop the words drifting.
A lesson that lives in only one of these is either unchecked, untaught or unanchored.

When I asked, near the end of the week, how to retrofit a lesson into the prompting, the build agent described exactly this, in practice rather than theory. The skill carries a lesson "as craft: a principle, the real example and your words, and a test." The judge's rubric "carries the same test, so a film that misses it gets named with a time." Code "measures it wherever it can be measured." And one sentence I've since adopted as policy: "The briefs stay short north stars and never grow rules. Your verdicts are recorded as test labels, so each new judge can be checked against what you actually said." Chapter 19 shows that answer in full, with the skill text before and after.

What goes wrong with only one carrier

Skill only

The builder knows the principle. Nothing checks that it survived. Intention gets mistaken for delivery (Chapter 10).

Harness only

The builder is punished for failing a test nobody taught it. It learns to satisfy the judge instead of the purpose (Chapter 11).

Principle and test, no cases

The words drift. "Warm" means whatever the next builder, or the next judge, thinks it means.

Why the contrasting cases are the carrier everyone forgets

Most teams have some version of the first two: a style guide and a review. Almost nobody keeps the third deliberately. It's the one that makes the other two mean something.

A positive example shows one good answer. It doesn't tell you which of its hundred features made it good. A pair does. The same opening with and without the person's own photo. The same line in a local voice and an imported one. The contrast points at the one thing that changed, and says: that. Chapter 2's variation theory is the principle; this is the carrier built on it.

The effect is measurable in language models too. Researchers at Intuit, trying to get models to write "in a certain style or tone that is hard to describe", found that giving the model "positive examples that illustrate the true intent, along with negative examples that show what characteristics we want LLMs to avoid" significantly beat ordinary few-shot prompting.17 A style that's hard to describe is exactly what taste is. You convey it better with this, not that than with a description, or with good examples alone.

There's a deeper reason the cases can't be dropped. Schön warned that "symbolic, procedural representations of tacit design knowledge are bound to be incomplete or inadequate in relation to the actual phenomena of designing."2 The skill's words will always be less than the judgment that formed them. The cases carry the remainder.

Rule one: reinforce without converging

The three carriers have to agree. They mustn't become the same thing.

Key Insight

A skill needs room to create a new good answer; an evaluator should not reject it merely because it differs from the first successful example.

Here's how convergence actually happens. The first good film has a device that works: a note filling in on screen with the customer's own words. The skill describes the principle behind it. The cases keep the film as the example. And then someone writes the harness test as "does the film have a consultation note?" instead of "where did the person's words change what happened?" Now the harness is testing the example, not the principle. Every future film needs a note filling in on screen, whether or not it fits, and a genuinely better device will fail review for being different.

I've drawn this line twice before. In The Exemplar Ratchet it was the difference between extracting the shape and extracting the wallpaper: test on a different world against the same bar, and "if they only win when the wallpaper matches, you extracted wallpaper." In Demonstrate Over Tell it was the template trap: one good expression copied everywhere. "Aim at the reader's need, not at an aesthetic." "The family resemblance should be visible value, not identical chat bubbles." "Specify facts; nudge taste." The carriers version of it is simple to say and easy to break: test the principle; use the example only to show what the principle means.

Rule two: reinforce without duplicating

The opposite failure is quieter. Write the principle three times, once in the skill, once in the rubric, once in the notes beside the examples, and within a week you have three versions. Somebody tightens the rubric's wording after a judge misreads it. Somebody else adds a clause to the skill after a builder over-applies it. Now the builder is taught one thing and tested on another.

I solved the same problem for knowledge bases in The Wiki Is the Kernel. Named documents that restate each other drift apart; the fix was to demote them to "boot profiles": an entry point and a selection bias over one shared set of pages. "Nothing is copied, so nothing can drift." In The Wiki Playbook, the same idea: "There is exactly one register page"; every profile points at it.

For taste: one canonical statement of each distinction, with its conditions, and three carriers that point at it and use it differently. The skill uses it to make. The harness uses it to check. The cases use it to show where it holds and where it doesn't.

Pitfall: context collapse

The skill is the carrier most likely to rot, because it's the one that gets rewritten. Researchers building self-improving "playbooks" for language models named the failure: "context collapse, where iterative rewriting erodes details over time", fixed by "structured, incremental updates that preserve detailed knowledge."18

So: update the skill item by item (lesson, condition, case, test) and never by asking a model to "rewrite the skill to include what we learned". And never compress a lesson to its slogan. Chapter 6's handles are exactly what's left when a lesson collapses.

The routing record

Put together, each lesson that survives triage gets one record. It's the storage form of Chapter 3's "judgment connected to examples, counterexamples and outcomes", and of the "rejections with reopening conditions" that Replay-Driven Design Evolution treats as compounding assets.

Three-carrier routing record

DistinctionAn id and one canonical sentence. Plus its conditions: when it applies, and when it would be wrong.
Skill entryThe principle; the real example; the rejector's own words; the self-check the builder runs before handing over.
Harness entryThe rubric line, the cold-viewer question, or the measured fact that checks it, and who owns it.
Contrasting casesThis, not that. Both versions kept, the verdict attached, dated.
OriginThe triage card it came from (Chapter 8): the motivating rejection and its date.
Reopen ifWhat would make us revise or retire it.

Test the principle. Use the example only to show what the principle means.

Look at what the three carriers do to a single judgment. The skill puts it in front of the builder: this is what to make. The harness puts it in front of a reviewer: this is what to look for. Those are two very different working positions for the same idea, and the second one turns out to matter more than it looks.

Key Takeaways

  • A lesson needs three homes: a skill that teaches the builder, a harness that checks the result, and contrasting cases that anchor the words.
  • The carriers must agree without converging. Test the principle, not the example, or every good new answer fails for being different.
  • And without duplicating: one canonical statement per distinction, pointed at three ways. Update the skill item by item; never let a lesson collapse into its slogan.

Part III · The Harness

Judgment on Both Sides of Production

The same judgment has two jobs. In the skill it tells the builder what to make. In the test it recognises when the intended quality didn't make it. Without the second, every principle runs on the honour system.

What surprised me most that week wasn't that my rejections changed the prompts. It was where else they turned up.

"When I've given my thoughts and rejections, they've ended up in the prompting, obviously — but they've also ended up in the testing. It actually tests for voice quality, and it's done some stuff saying, well, this is an Aussie marketplace, let's make sure we've got Aussie voices — and it's gone and tested those voices."

— Me, near the end of the week

"Obviously" is doing a lot of work in that sentence. Everyone expects feedback to end up in the instructions. What I hadn't expected was to find my judgment on the other side of production too, sitting in the checks, rejecting films I'd never seen. (How that particular voice lesson came to be is Chapter 17's story. Here it's just the example of a judgment living in two places.)

Two positions for one judgment

In the skill

It helps the system choose what to make.

"Build a recognisable relationship with this audience."

In the test

It helps the system recognise when the intended quality did not survive.

"Where is that relationship actually visible or audible?"

Those are complementary uses of the same judgment, and the second is the one that does the protecting. An instruction can be satisfied by intention alone. The builder can sincerely believe it made warmth, recognition, clarity; it read the instruction, it tried, it will tell you so. The reviewer's job is to inspect what was delivered, not what was meant. Without the test, every principle in the skill is on the honour system, and builders, human or AI, are generous graders of their own intentions.

From one rejection to a way of examining everything

The move that puts a judgment into the test has a shape, and it's worth drawing because it's the opposite of how most feedback gets stored.

A specific rejection→An explanation of the mismatch→A more general selection principle→A way to examine future candidates
The progression that turns one person's "no" into something that checks work they'll never see.

Walk it with the voice, one step at a time. "I don't like that voice." Then the mismatch: the delivery puts the speaker in the wrong relationship with the audience. Then the principle: cast the voice from the audience's place. Then the examination: a listening check that asks whether this voice sounds like it belongs where the audience is.

Compare that with how most teams store the same event: a note somewhere that says "Scott doesn't like voice seven". That note can't examine anything. It can only forbid one voice, forever, for one person's reasons, which nobody remembers.

The last step is where most of the value is, and where the principle has to be stated carefully. The portable lesson isn't "always use an Australian voice". It's to consider where the audience is, who the speaker is meant to be, and what relationship the delivery should establish. A local accent is one application of that. For a service sold nationally, or a founder who speaks for their own company, the same principle picks a different voice. The test has to check the principle, not its first application; that's Chapter 9's first rule, doing its job.

Declared, then perceived

The cleanest way I've found to put a principle into the test is to make the builder commit to it before anyone checks. The builder declares, with times, where it meant the recognition to land and where it meant the viewer to understand how the service works. Then the harness asks a viewer who has seen nothing but the film to find those moments, and compares.

That turns "recognition in the first few seconds" from something the builder believes it delivered into something the harness can hold it to. The method itself, including why asking a viewer "did you have a moment?" tells you almost nothing while asking "did you find the moment we declared, at the time we declared it?" discriminates, belongs to the sibling book, and I'll leave it there. What matters here is what it's for: it's the place where the author's judgment lands inside the harness.

The instrument learning to state the standard

There's a subtler thing that happens once judgment lives in the test. The test starts to improve its own vocabulary.

The judges' rubric that week had a criterion called "connection". It was marked down often, and when the build agent looked at why, it found the criterion was mixing two different things: whether the viewer recognised their own situation, and whether they understood how the service worked. Those can come apart. A film can make you feel seen and leave you no wiser; another can explain beautifully to someone who never felt it was about them. So "connection" was split into recognition, being heard and the aha, each with its own test (the definitions are in Chapter 6's table). The standard didn't change. It got stated more precisely, and so it got observed more precisely.

Key Insight

The system is learning not only how to meet the standard, but how to state and observe the standard more usefully.

Criteria shape the work before anyone judges it

Anthropic's write-up of its design harness has two lines I think are under-read. Its author "wrote four grading criteria that I gave to both the generator and evaluator agents in their prompts." Same criteria, both sides of production, exactly as above. And then the surprising finding: "Even on the first iteration, outputs were noticeably better than a baseline with no prompting at all, suggesting the criteria and associated language themselves steered the model away from generic defaults before any evaluator feedback led to further refinement."9

Read that carefully, because it cuts both ways. A criterion is a production input, not only a test. Stating what the judge will look for changes what gets made before any judging happens. That's the power of putting judgment on both sides. It's also the danger: whatever quirks the criterion's wording carries, the builder inherits them. Chapter 11 is about that danger.

A practitioner who builds LLM judges for a living, Hamel Husain, puts the prerequisite bluntly: "You cannot write a good judge prompt until you've seen the data." And when domain experts are made to decide pass or fail on real outputs, "they are compelled to articulate their expectations clearly. This process uncovers nuances and unspoken assumptions."19 That's Chapter 2 again, from inside the harness: the test's criteria are formed by judging attempts, not written first.

A judge for comparison, a stranger for truth

In Demonstrate Over Tell I drew a line between two instruments that people confuse. A fixed judge, holding the same criteria while you vary the work, is genuinely useful for comparing versions. But its score "is not evidence that a reader understood anything. It tells you what the judge rewards." Hence the rule: "Keep the judge for comparison. Add a comprehension test for truth."

For taste, both instruments should be fed from the same distinction. The judge compares versions against it. The cold viewer's questions test whether it landed on someone who knew nothing. One source, two instruments, which is Chapter 9's no-duplication rule again, in the harness this time.

Where judgment lands: one distinction, four forms
DistinctionSkill (what to make)Judge rubric (what to look for)Cold viewer (what a stranger is asked)Measured fact
RecognitionOpen on a specific detail from the viewer's own life, shown not described.Name the detail and its time; a generic smiling person fails."Was there a moment you recognised your own life? Which detail?"None. The declared time is checked against the viewer's answer.
Being heardThe person's own words come back inside the service's response.Where do the person's words change what happens?"Where did the person's words change what happened?"None.
One thing only this company hasUse the company's own material for what makes it distinctive; generated imagery for mood only.Hide the logo: name what only this company has."What would you get here that you wouldn't get elsewhere?"None.
Cast from the audience's placeConsider where the audience is, who the speaker is meant to be, what relationship the delivery sets up.Does the voice belong where the audience is? (Trust a listening judge here, not a transcript.)"Did any voice sound out of place? Whose?"Voice quality grade, where the engine publishes one.

Shape Four rows from the week, abbreviated. "None" in the last column is common and honest: most of fit can't be measured by code, only asked about.

Put judgment on both sides of production and something happens that feels like success at first. The tests start saying no. Often. On things no linter would ever catch. Films get stuck. Is that the harness working, or the harness going wrong?

Key Takeaways

  • One judgment, two jobs: in the skill it chooses what to make; in the test it catches when the quality didn't survive. Without the test, principles run on intention.
  • Store rejections as a progression, not a preference: rejection, mismatch, principle, a way to examine every future candidate.
  • Criteria are production inputs as well as tests. Stating what the judge will look for shapes the work before anything is judged, for better and for worse.

Part III · The Harness

Taste as the Bottleneck, and the Superstition Trap

A harness that rejects on taste is the goal. It is also the most dangerous thing in this book, because a strict judge without diagnosis teaches everyone the wrong lesson, and a lesson without conditions hardens into ritual.

Two things I said at the end of the week, a minute apart, sum up where this chapter starts.

"It shows up that the test harnesses are slowing down the final approval of videos — on taste. Which I think is astounding."

"Then it gets stuck on one or two videos — stuck in a loop where it won't pass the branding. Which is good, I guess."

— Me, end of the week

The first is delight: a test suite blocking on taste, not bugs. The second has the right instinct buried in its last two words. "I guess." A stuck film might be the harness doing its job. It might also be the harness quietly teaching the builder the wrong thing. From the outside, the two look identical.

When the bottleneck moves

Something changes once a system can make a plausible artefact faster than it can establish that the artefact deserves to ship. The hard question stops being "can we manufacture this?" and becomes "have we made the right experience?" At that point the harness isn't a unit-test suite any more. It's a creative-review process, with everything that implies: judgment calls, taste disagreements, the risk of a reviewer whose preferences quietly become everyone's.

That's the right place for it to be. It's also why the rest of this chapter matters.

Key Insight

A rejection is valuable when it identifies a meaningful discrepancy.

Three reasons repeated rejection can mean nothing

  1. The criterion is vague. The judge is rejecting on a handle with no discrimination behind it (Chapter 6). "Not premium enough" can reject anything forever.
  2. The judges conflict. Two instruments are answering different questions, and the loop oscillates between them. Fix one judge's complaint and you've created the other's (Chapter 4's craft-versus-connection split).
  3. The builder is being pushed toward the evaluator's favourite style rather than toward the intended outcome. Each round, the work gets more like what the judge rewards and less like what the job needed.

The diagnostic: if three rounds of rejection haven't produced a new distinction, a changed test, or a better artefact for a stated reason, stop fixing the artefact and triage the harness instead (Chapter 8).

Evaluators steer

The third reason is the one that deserves the most suspicion, because it looks like progress. Scores go up. Rounds get shorter. The work gets steadily more like one particular thing.

Anthropic's design-harness write-up reported exactly this: the wording of its criteria, phrases like "the best designs are museum quality", "pushed designs toward a particular visual convergence."9 I made a meal of that line in Demonstrate Over Tell, so I'll leave it as one clause here. The general pattern has been measured more formally. Optimise hard enough against an imperfect proxy for human preference and "optimizing its value too much can hinder ground truth performance, in accordance with Goodhart's law."20 And creative work done with AI help has been found to score better individually while losing variety collectively: stories written with AI ideas "are more similar to each other than stories by humans alone… an increase in individual creativity at the risk of losing collective novelty."21 One artist who tested generic AI aesthetic judges against her own taste found they "felt overly general rather than tailored to their aesthetic sensibilities."22

For most work, homogenisation is a side effect. For a brand, it's the whole failure. A brand's job is to be this company. A harness that nudges every client's films toward the same evaluator-pleasing look has made each film better and every brand worse.

The opposite failure exists too, and it's worth one sentence so nobody reads this chapter as an argument for lenient judges. The same Anthropic author, early on, "watched it identify legitimate issues, then talk itself into deciding they weren't a big deal and approve the work anyway."9 Strictness isn't the enemy. Undiagnosed strictness is.

Who guards the judges?

Two of my own frameworks already had pieces of the answer.

In The Exemplar Ratchet I named critic-taste drift: "Promotion to exemplar stays with a human. If the loop's own critics decide what counts as greatness, the ratchet drifts toward the critics' taste. That is specification gaming with a friendly face." And in the same book: "If you optimise against a twelve-point rubric, you will get pages that score well on every point and are bland. Use the rubric to diagnose. Decide between pages with a single question: which would you rather receive?"

In Your AI Partner Is the Challenger I made the rule about roles: "Challenger is a feature. Arbiter is a procedure." And: "Enthusiasm is not ship. Scepticism is not kill. Both are prompts to instrument." An enthusiastic judge's high score and a harsh judge's low one are both challenges. Neither is the verdict. Chapter 16 shows a real pair: one judge called a film a masterclass, another scored it six, and the useful thing was the reason attached to the six.

The triage question preserves the value of strict review without enthroning the reviewer.

Asking "is this a defect in the artefact, in our perception, or in our account of what we want?" treats every rejection as evidence to be located, not an order to be obeyed. A harsh judge gets taken seriously and still gets checked.

There's an obvious objection, and I'd rather meet it than have you think it. Isn't a harness that rejects on taste just your taste, enforced? It would be, if verdicts skipped triage and conditions. Under this method, my own verdicts don't become edicts. They become test labels: a judge worth keeping should agree with them, and when it doesn't, that's a finding about the judge or about me. Even the author is a challenger.

The superstition trap

Now the failure that worries me most, because it's the one that hides inside success.

In 1948, B. F. Skinner fed pigeons at fixed intervals regardless of what they did, and watched them develop rituals. One turned anticlockwise; another thrust its head into a corner. Whatever each bird happened to be doing when food arrived, it did more of. "The bird behaves as if there were a causal relation between its behavior and the presentation of food, although such a relation is lacking. … A few accidental connections between a ritual and favorable consequences suffice to set up and maintain the behavior in spite of many unreinforced instances."23

Skills do exactly this. One voice gets rejected, and the lesson written down is "no voices like that", so every similar voice is banned forever. One pause lands beautifully before a promise, and pauses become compulsory everywhere. One film works with a note filling in on screen, and on-screen notes become house style. Each lesson was true once. None of them carried the condition that made it true, so each one became a ritual the next builder obeys without knowing why.

Pitfall: the superstition trap

A taste lesson hardens into superstition when it loses its conditions: a principle that was true here, for this audience, for this reason becomes a rule applied everywhere. The tell is a rule nobody can explain the origin of, obeyed on work it doesn't fit.

I've met this failure in other forms and written about it each time. In The Wiki Playbook it's calcified lore: "A conditional pattern hardens into an unconditional rule… The tell: a claim with no conditions attached that everyone obeys." In Institutional Memory Not Cognition it's what you get when you skip the stale-context check, asking what conditions made the original judgment true and whether they still hold: "Without this check, you do not get institutional cognition. You get institutional superstition with better search." In Made From You, about a founder's judgment: "We need to know when a judgement applies and what evidence would overturn it. Otherwise a sensible lesson becomes a rule applied everywhere." And in Demonstrate Over Tell, the first warning: a picked reason is "evidence about this moment, not a permanent preference."

The guard is conditions, not force

The usual instinct, when a lesson seems important, is to state it more strongly. Always. Never. Must. That's exactly backwards. In The Perturbation Review I built a ladder for how far a lesson from one engagement is allowed to climb, and the lowest rung carries the most important sentence: a local lesson is "true here, stays here. A success, not a shortfall." Promotion needs evidence from elsewhere: "Recurrence nominates. It does not promote." And the rule for a single striking case: "n=1 may climb, and it arrives wearing its ceiling."

Lesson-with-conditions record

The principleOne sentence.
Where it came fromThe triage card (Chapter 8): which rejection, which date.
Applies whenThe conditions under which it was true.
Wrong whenA named counter-case, even a hypothetical one.
CeilingLocal · candidate · general.
Promote if / demote ifThe evidence that would move it up (a successor test, Chapter 26) or down (a counter-case that bites).

From the week "Cast the voice from the audience's place." Applies when: a local service speaks to a local audience. Wrong when: the offer is deliberately national or international, or the voice belongs to a known person speaking for their own company. Ceiling: candidate. Promote if: a successor on an unfamiliar company casts correctly without being told the accent.

A principle becomes more useful as its conditions become clearer, not simply as its wording becomes stronger.

That's Part III. Three questions, triage, three carriers, judgment on both sides, and conditions on everything. One thing it doesn't explain is the thing that started this book: why the agent that watched all of this wrote the best account of what the work was for. That needs a different kind of chapter.

Key Takeaways

  • When making outruns judging, the harness becomes a creative-review process. A rejection is valuable only when it names a meaningful discrepancy.
  • Repeated rejection can mean a vague criterion, conflicting judges or an evaluator's favourite style. After three undiagnosed rounds, triage the harness, not the artefact.
  • Superstition is a lesson that lost its conditions. Guard with conditions, ceilings and counter-cases, not with stronger wording.

Part IV · Theory From Practice

Why the Informed Supervisor Explains Best

Asked at the start of the work, "why are we making these films?" invites a textbook answer. Asked at the end, the same question has a pattern of decisions behind it that needs explaining. The model hasn't become cleverer. The question has.

Ask the question twice. "Why are we making these films?" Once at the start of the work, once at the end. Same agent, same instructions. Look at what each answer has to work with.

One question, asked before and after the work
Before the workAfter the work
What's behind the questionA brief, the client's public material, general knowledge of marketing.All of that, plus: Why did this polished version fail? Why did we reject that voice? Why was this pause important? Why did a technically correct scene still miss the point? What did several different repairs have in common?
The answer that material supportsCompetent and general: awareness, engagement, trust, conversion.Specific. It has to account for each of those contrasts, so it can't lean on generic language.
What it's good forA briefing anyone could have written.A principle that could have prevented the failures.

At the start, the question invites a textbook answer, and a good model gives a good textbook answer. By the end, the textbook answer is visibly inadequate. It can't explain why the beautiful film failed, or why the voice was wrong. An explanation has to account for those contrasts or it's no explanation at all. So the answer gets better, not because the writer improved, but because the problem did.

My thinking partner's phrase for what the supervisor had acquired is the best one I've found: a pattern of decisions that needed a coherent explanation.

Theory formation from practice

Put that as a cycle and it becomes something you can run on purpose.

  1. The artefact is an attempted answer. The film is a guess at what the viewer needs.
  2. The rejection is evidence the answer missed something. A judge, a viewer or a person says where.
  3. The explanation is an attempt to state a principle that accounts for what the attempts revealed, across all of them, not just the last.
  4. The principle goes back into production. The next attempt is made with it, and tests it.
Theory formation from practice: the account of what the work is for gets written by the work, and then rewrites the work.

Making improves the explanation; the explanation improves the next making.

I described it at the time without any of that vocabulary, with a fair bit of surprise in my voice:

"It's gone around in this loop and it's looking at itself. It was the meta loop — the main top loop — that I asked to write the web page. It had seen the video production, seen the brand failures, seen my prompting, and then it wrote this page about what the videos should be doing. It's really crystallised its own thoughts. It's watched its own and other models' rejections, what's worked and what hasn't, and our own prompting, and then it's able to explain really clearly what we're trying to do in the videos."

— Me, end of the week

Why ask the top of the loop, not a worker?

There were several agents involved that week: builders, one per film; judges; a cold viewer. The one I asked for the page was the supervisor, the agent that dispatched the builders, read the judges, relayed my verdicts and ran the fix rounds. That turned out to matter.

A local worker knows the repair it's making. It knows its own film had music too loud under the voice and it turned the music down. The supervisor has access to something no worker has: the relationships among repairs, the original purpose, my interventions and the critics' disagreements. Its valuable job isn't to combine the workers' reports into a summary. It's to notice that several apparently different problems are one failure. Three films marked down for different reasons (posed tools, a static end card, generic imagery) might all be failing the same principle: nothing on screen is about the viewer's own situation.

The practical rule follows directly. If you want the account, ask the agent that held the whole run, at the end of the run. Don't hand a summary to a fresh writer and ask it to explain. A summary is exactly the thing that throws the contrasts away.

The same model, a different problem

This connects to an argument I made in The Inference Field about why two context windows of the same size can be "cognitively nothing alike". One built by retrieval is a pile of plausibly relevant material, with the work of finding structure left to the model at the last moment. One built by walking is "the serialised trace of a system progressively constructing its own understanding", where "every step in that trace is still in the room, still conditioning the next one." The supervisor's context at the end was that second kind. Every build, every rejection and every repair was still in the room when I asked the question.

And it connects to a distinction from Experience Is Compressed Priors: "Domain priors change what you try. Process priors change how you try." I described process priors as "how you get better at asking that second question with an AI that can supply historical structure, while you supply direction, taste, and the recognition of what is still wrong." The page the supervisor wrote is a domain prior: what these films are for. The way it got written, asking the informed supervisor to account for the whole run, is a process prior. Keep both. The second is the one that will help on the next job.

The research cousin

There's a close technical parallel in GEPA, the prompt optimiser from Chapter 7. It "samples trajectories (e.g., reasoning, tool calls, and tool outputs) and reflects on them in natural language to diagnose problems, propose and test prompt updates, and combine complementary lessons." When traces are "paired with the final outcome of the system (e.g., success or failure), they provide substantial diagnostic value, allowing practitioners to trace errors or successes back to specific decisions." Language models, it says, can use these traces "to perform implicit credit assignment, attributing responsibility for the final outcome to the relevant modules."14

That's the supervisor's job, described for a benchmark. I want to be precise about what the parallel does and doesn't show. It shows that detailed experience, reflected on in language, supports better updates than a bare score. It doesn't show that anything has solved taste: GEPA's tasks have scores you can compute, and fit, mostly, doesn't. And the learning-science reason the account lands after the contrasts is the one from Chapter 5. Contrasting cases create "a time for telling".

How to ask for the account

If the supervisor's explanation is this valuable, don't leave it to a lucky request at the end of a week. Ask for it deliberately, with questions that make it account for the contrasts rather than summarise the activity.

Three accounting questions for the end of a run

  1. What do these attempts teach us about the task? Not "summarise what happened". The task, not the history.
  2. Which apparently different failures were really one failure? This is the question only the supervisor can answer, because only it saw all of them.
  3. What principle would have prevented them, under what conditions, and where would it be wrong? The last clause keeps the answer from becoming superstition before it's even been written down (Chapter 11).

Pro Tip

Ask the agent that held the whole run to account for it, at the end of the run, with questions about the task rather than the history.

The page I was handed that week is shown in full in Chapter 15, with a timeline of what the supervisor had seen by the time it wrote it. And Chapter 18 shows what happened when that page's account met the development records: they didn't entirely agree.

Which points at the limit of everything in this chapter. The supervisor explains best because it saw everything. That same fact makes it the worst possible judge of whether the finished work makes sense to someone who saw nothing.

Key Takeaways

  • The explanation improves after the work because the question has sharper material behind it: a pattern of decisions that needs a coherent account.
  • Theory formation from practice: the artefact is an attempted answer, the rejection is evidence, the explanation states a principle, the principle goes back into production.
  • Ask the agent that held the whole run, at the end, with three accounting questions. Treat the answer as a candidate.

Part IV · Theory From Practice

The Informed Supervisor and the Cold Reviewer

The agent that knows the most is the one that can't tell whether a stranger would get it. So you need two roles, deliberately kept apart: one to form the principle from everything that happened, one to test the work knowing nothing at all.

Ask the supervisor whether an opening connects, and it will answer from inside everything it knows about what the opening was meant to do. It can't help it.

It knows the brief. It knows which moment the viewer is supposed to recognise from their own life, because it wrote that moment into the storyboard. It knows the offer, so a shot of the offer itself reads, to it, as obviously relevant. Asked "would a stranger understand this?", it simulates a stranger who, somehow, knows all of that too. Economists named this failure decades before anyone built an AI.

"Better-informed agents are unable to ignore private information even when it is in their interest to do so; more information is not always better."

— Camerer, Loewenstein and Weber, on the curse of knowledge

The study that named the curse of knowledge found that better-informed people systematically failed to predict what less-informed people would do, even when they were paid to get it right. When the informed traded in a market with real stakes, market forces "reduce the curse by approximately 50 percent but do not eliminate it."24 Money couldn't buy an informed person their ignorance back. Neither can a prompt.

~50%

How much market forces reduced the curse of knowledge, with real money at stake

Still there

What was left: better-informed people still couldn't predict the less informed

Two roles, two questions

The informed supervisor and the cold reviewer
Informed supervisorCold reviewer
The question it asks"What do these attempts teach us about the task?""Does this artefact communicate without knowing everything that went into it?"
What it's fedEverything: the brief, every build, every rejection, every judge's report, the author's verdicts.The artefact. A persona describing who they are. Nothing about the offer, the brief or where it'll be shown.
What it's good forForming the principle: seeing that several failures are one.Testing the work: does it stand on its own?
What it's bad atJudging whether a newcomer would get it.Explaining why anything failed; it doesn't know what was intended.
When it runsAt the end of a run, to write the account.On each artefact, before it ships, and on the next artefact after a principle changes.

Key Insight

Rich history helps form the principle. Deliberate ignorance helps test whether the finished work stands on its own. You need both positions.

"Can't you just tell the supervisor to read it fresh?"

It's the obvious shortcut, and it doesn't work. The curse of knowledge is precisely the inability to set private information aside on request. Tell an informed agent to "imagine you've never seen this before" and you get an informed agent's idea of a newcomer: someone who happens to find all the right things obvious. The simulation is contaminated by the thing it's trying to remove.

You need a different agent. Different context, different time, different job. That's not a luxury. It's the only arrangement that actually tests what you care about.

Myth

A sufficiently capable reviewer can read the work as a newcomer would, if you ask it to.

Reality

Nobody can un-know. If you want a newcomer's reading, get a newcomer.

I had half of this already

In The Exemplar Ratchet I described the cold-arrival reader, who "arrives with no context on purpose, often in a customer's voice", spends about twenty seconds with the page, and answers two questions: what does this company do for you, and what would you do next? The point of it: "That is evidence about a reader, not your opinion. It depersonalises critique." In Demonstrate Over Tell I added two cautions: test "people who were there, and people who weren't", and treat a fresh AI reader as "a screen, not a verdict. A model reading a page is not a customer reading a page."

That was the cold half. What the films added was the informed half, and the rule that holds the pair together: the informed role forms, the cold role tests, and neither is allowed to do the other's job. A cold reviewer asked to explain a failure will invent a plausible reason, because it has no access to the real one. An informed supervisor asked whether the work lands will say yes, because to it, it does.

What actually makes a reviewer cold?

"Cold" turns out to be harder to achieve than it sounds. Most "cold" reviewers are lukewarm: they've been told something that warms them up without anyone noticing. Here's the checklist I now use.

A reviewer is cold only if

  • It has never heard of the company or its offer. Not "a potential customer of this company". Someone who doesn't know the company exists.
  • It isn't told where the work will be seen. A placement note ("for people who've visited the offer page", "retargeting") quietly licenses the work to assume what they've seen.
  • Its persona describes the buyer, not the artefact's hook. Write "a woman in her forties who's wondered about fixing a tooth that bothers her in photos", not "a woman whose front tooth looks shorter than the others". The second hands the viewer the answer.
  • It's asked about its own life, not about the person on screen. "Did you recognise something you've done?" rather than "is this person like you?"
  • It's asked to find declared moments at declared times, rather than whether it had a moment (the method is Code as Proxy's).
  • Words and picture are answered separately. A line can land while the picture doesn't, and a combined "yes" hides it.

The second bullet on that list isn't hypothetical. In the week this book comes from, a viewer that had been told it had already seen the ads passed an opening I'd scored six out of ten, and called its moment of recognition "specific". A viewer that had never heard of the business was harder on it, and in one run said my verdict back to me in its own words: it would never have been on the offer page; it would just be scrolling. One clause in a persona moved the harness towards my verdict. Not in every run, and Chapter 19 shows all of them, with both personas side by side.

Keep them apart in practice

  • Separate context. The cold reviewer gets the artefact and a persona. Nothing from the supervisor's history leaks in, including file names and captions that describe intent.
  • Separate time. The supervisor writes its account after the run. The cold reviewer tests the next artefact made under that account, not the account itself.
  • Separate authority. The supervisor's explanation is tested by what the cold reviewer finds in the next piece of work, never by the supervisor's own assessment of whether its explanation was right.

Anthropic's design-harness write-up reached the same arrangement from engineering pragmatism: "Separating the agent doing the work from the agent judging it proves to be a strong lever"; "tuning a standalone evaluator to be skeptical turns out to be far more tractable than making a generator critical of its own work."9 The deeper reason models are poor judges of their own work, including their tendency to prefer what they produced, is covered in the sibling book; I won't repeat it.

So the artefact now has its test: a reviewer who knows nothing. But the supervisor produced something else as well, the eloquent account of what the work was for. What tests that?

Key Takeaways

  • The informed supervisor forms principles; the cold reviewer tests whether the work stands alone. Neither can do the other's job.
  • You can't instruct an informed agent to read cold. Nobody can un-know. Use a different agent, in a different context, at a different time.
  • Most "cold" reviewers are lukewarm. Never tell them the company, the placement or the hook; ask about their own life; split words from picture.

Part IV · Theory From Practice

An Eloquent Explanation Is a Candidate

The supervisor's account of what the work was for is the most persuasive thing the process produces. That's exactly why it can't be trusted on persuasion. It earns its place by helping with a case it hasn't seen, and by surviving the records.

A good explanation of a finished job has one characteristic flaw. It makes the previous case sound inevitable.

Every choice fits. Every rejection was obviously right. The principle was there all along, waiting to be noticed. Reading it, you feel the satisfying click of a story that accounts for everything. That feeling is what makes the explanation persuasive, and it's evidence of nothing. A story that accounts for everything that happened is easy to write after the fact. The question is whether it accounts for what hasn't happened yet.

An explanation earns its place in the skill when it helps with a new case, not merely when it makes the previous case sound inevitable.

Kahneman and Klein put the underlying problem in one line: "Subjective experience is not a reliable indicator of judgment accuracy."10 That's true of the reader's feeling that the account is right. It's equally true of the writer's.

The records kick the story

If an explanation needs something outside itself to test it, the obvious candidate is a new case, and Chapter 26 designs that test. But there's a second check that's available immediately, and it's easy to skip because it feels like bookkeeping: the records of what actually happened.

I noticed this in the conversation after the week, when my thinking partner started reading the development records alongside my account of what had happened:

"Here's the other cool thing: you're looking at my dev records and conversations, and that's acting as perturbation on our discussion of what we're doing. It's increasing its ability to understand the process of understanding."

— Me, after the week

It's the mechanism from Chapter 2, one level up. Attempts kick a builder's understanding of the work. Records kick an explainer's understanding of the attempts. And the reason they're useful is the reason they're uncomfortable: they can contradict the neat story. The records weren't written to support anyone's account. They're the one witness that didn't know what story was going to be told.

There are two kinds of contradiction worth looking for every time.

Provenance

Who actually originated the idea? The neat story credits whoever explained it last, or whoever is most impressive to credit. The records know who said it first.

Approval

Whose verdict does a score actually represent? The neat story treats a judge's high score as the author's yes. The records know whether the author ever looked.

Both contradictions turned up in my week, and neither was flattering to the neat story. Chapter 18 shows exactly what the records said. For now, the doctrine: keep the records, and read them before you promote an explanation into the skill.

Four columns that keep an account honest

The simplest discipline I know is to make every claim in an explanation declare which kind of claim it is. My thinking partner suggested four kinds, and I've used them since.

Four columns for any account of how the work went
Supplied judgmentDeveloped expressionProposed testsObserved results
What the author, the client or the brief brought to the work before it started.What production made concrete: the device, the line, the scene, the sharpened term.What the harness now checks, and how.What actually happened when the work met people. Including, honestly, "nothing yet".

Every claim goes in exactly one column. An idea that sits in "supplied judgment" can't also be credited as a discovery. A test that sits in "proposed" can't be quoted as evidence. And a blank "observed" column is a finding, not an embarrassment; it tells the reader exactly how far the account can be trusted.

Four agreements, one observation

There's a subtler trap. After a good week you can end up with four things that all agree with each other: the brief, the artefacts, the supervisor's page and your own discussion of it. It feels like four confirmations. It's one.

Important

The brief, the artefacts, the explanation and a discussion of it are connected derivatives, not independent confirmations. Their value comes from asking new questions of the evidence, not from restating the same interpretation until it feels established.

The page was written from the brief and the films. The discussion was written from the page. Of course they agree; they're one lineage. In Designing Loops, Not Prompts I gave the rule for this in a different setting: "derived output ranks below source evidence. A hard-won synthesis can be filed back, but typed as derived — cache, not evidence; subordinate to its supports; stale when they change… Skip that and the system starts citing its own echoes, confidently, and you will not notice for months." The supervisor's page is derived output. The development records are source evidence. When they disagree, the records win.

The failure has a tell, which I described in The Wiki Playbook for a knowledge graph that consolidates too eagerly: "A janitor with a vague directive merges two distinct old ideas into one false claim, silently erasing a real difference. The tell: a page that reads more confidently than any of its sources." An after-the-loop explanation that reads more confidently than any single record it came from is showing exactly that tell.

The same thing has been measured for AI judges, in a narrower form: a panel of judges fed the same inputs "never significantly beats its best member", however their verdicts are combined.25 Agreement among things that share their inputs isn't independent evidence. (What that means for building judge panels is Code as Proxy's territory.)

Where the explanation goes, and how it's filed

None of this means throwing the explanation away. In Replay-Driven Design Evolution the list of what should survive a burned-down build included a folder of rejections, each kept with its reopening conditions, and the conclusion was that the durable outputs are "the harness and the history", not the first codebase. The explanation joins that history. It goes in dated, marked as derived, with its claims sorted into the four columns and its principles carrying their conditions and ceilings (Chapter 11). What it doesn't do is become the new source of truth just because it's the best-written thing in the folder.

And its ceiling is set by the rule from The Perturbation Review: "n=1 may climb, and it arrives wearing its ceiling." An explanation of one day's films is an n of one, however eloquent.

Is this explanation still a candidate? Six questions

  1. What new case would it help with? Name one. If you can't, it's a description, not a principle.
  2. What does it predict that we haven't seen yet? An explanation that predicts nothing can't be wrong, which means it can't be tested.
  3. Which records could contradict it, and have we read them? Provenance and approval, at minimum.
  4. Is any "independent" support actually a derivative of the same lineage?
  5. What's its ceiling? Local, candidate or general.
  6. Which of its claims are in the "observed" column, and which only in "proposed"?

The records, my thinking partner said, "are therefore not merely memory of the work. They are material for reasoning about how the work learns." That's the reason to keep the raw sessions, not just the tidy summary of them, however beautiful the summary is. The summary tells you what the work concluded. The records let you check whether it was entitled to.

Three checks, three sources of independence

Part IV has built three checks, and it's worth seeing them together, because each one gets its independence from a different place.

The supervisor explainsIndependent of any single worker: it sees across all the attempts (Chapter 12).
The cold reviewer tests the workIndependent of the history: it knows nothing about what was intended (Chapter 13).
The records and a new case test the explanationIndependent of the story: they were never written to support it (this chapter).

That's the doctrine. The next part is the evidence it came from: one day of films, from the page that started this book to a single rejection walked through all three of its lessons, in the order the records give it, with the parts that corrected the story left in.

Key Takeaways

  • A persuasive after-the-fact explanation is a candidate. It earns its place by helping with a new case, not by making the last one sound inevitable.
  • Records are the witness that didn't know the story. Check provenance and approval against them before promoting any explanation.
  • Four agreements from one lineage are one observation. File the explanation as derived, sorted into supplied, developed, proposed and observed.

Parts I to IV made the argument without the evidence. This part is the evidence, in the order the development records give it, with the parts that make the setup look less clever left in. Almost all of it happened in one day.

Part V · One Day of Rejections, Walked

The Page That Explained It Better

Four films in, I asked the agent supervising the work to explain what they were for. The page it wrote is where this book started. Here it is, with what the agent had seen by the time it wrote it, and what the page changed next.

The day began with films for businesses that exist only on my own platform.

There's a follow-up service for people home from intensive care, a farm spray-contracting service, and ten others, each with a website an agent had built and each getting a one-minute film. Partway through, I added a job that was different in kind: a short series for a small cosmetic-dental clinic. A real business with a real offer and, as I'd expected, no brief. So I supplied one myself, generated with AI beforehand from my own frameworks and what we'd already learned on the concept films.

Four films were built for the clinic, judged, and sent back for repair. While the repairs ran, I asked the agent that had supervised all of it for something else.

"Then I asked it to write a page about the videos: why they're there, how they work, the marketing, the connection. And holy dinkums, did it explain it well. The branding, and what the video's there for, way better than I could have. And I'm not bad at marketing and branding."

— Me, afterwards

Chapter 1 made the claim in the abstract. This is the page.

What the page said

It opened on an idea none of us had put in those words.

"People don't arrive with dental words. They arrive with one tooth."

— The supervising agent's page

The paragraph under it did the work a brief usually fails to do. Nobody books a consultation thinking "lateral incisor proportion", it said. They've noticed something in photos for years: "one tooth a bit shorter, a chip, an edge worn flat." And then a sentence I'd have been proud to write: "What they're unsure about is whether it can change without everything changing, and whether they'll be talked into more than they wanted."

So, the page went on, the films don't claim the clinic listens. "They let the viewer watch it happen: someone points at the part they mean, says what they'd change and what they'd keep, and those words visibly carry through into the plan." Hold on to that phrase, what they'd change and what they'd keep. Chapter 18 goes looking for where it came from, and the answer isn't the one the page implies.

From there it set out the design of the films as four principles, each one about the viewer rather than the clinic.

Show, don't tell

"Every promise in the films has a moment that shows it… A viewer takes on trust what they're told, but they believe what they watch."

Start in their world

"Each film opens on something the viewer already handles… The film is about them before it's about the clinic."

Their words travel

"What the person says at the start turns up later… That thread is the story: the viewer sees their own question shaping what happens next."

No results, no reveal

"There are no before-and-after shots, no 'new smile' and no transformation story… They also make weaker films, because they promise an outcome nobody can promise."

Quoted from the page, with the clinic, its people and its offer removed.

It insisted the voices sound local, "not like an American ad". And it gave each film "one job, for one moment in someone's decision". I won't walk the films one by one here. What matters is that the page thought in decisions, not deliverables.

Read those lines together and one thing stands out. Every one is organised around the viewer's concern and the viewer's language, not the clinic's features. My brief had asked for that in principle. The page said it more sharply, and in a form a builder could act on.

What it had seen by the time it wrote

Chapter 12 argued that the supervisor explained best because, by the end, it had a pattern of decisions that needed explaining. Here's that pattern, as it stood on the day.

What the supervisor had seen by the time it wrote

  1. Films for the concept companies, built, judged and harvested into a skill. (That story is Code as Proxy's.)
  2. My verdict on a voice in one of them: "crappy compared to the rest, seems like older tech". The voice was banned. (Chapter 17)
  3. Its judges calibrated against my own verdicts, and one of them caught preferring the voice I'd rejected. (Chapter 17)
  4. My brief for the clinic, with its central question. (Chapter 18)
  5. Four clinic films, each judged three ways. The short craft film scored 8.8 from one judge and 6 from another, whose reason was that the shots "never connect to what a viewer notices". (Chapter 16)
  6. As it wrote: repairs running on all four, and the craft film's first repair still scoring 6, because "nothing visibly changes on screen". (Chapter 16)
In the order the development records give it. Every item is a contrast the page had to account for.

Set that list beside the page and you can watch the page answering it. Why did a beautiful film fail? Because craft that doesn't touch what the viewer has already noticed is a still life; hence "start in their world". Why did the tools have to work on screen? Because "a viewer takes on trust what they're told, but they believe what they watch." Why was a voice wrong? Because a speaker has to sound as if they belong where the viewer is. Generic marketing language couldn't have accounted for any of it. The page had to, so it did.

The build agent's own account, when I later asked what we'd learned, was more modest. Explaining each film under the same four headings (its job, its story, how it links to the viewer, where to use it) "was clearer than any brief we wrote." Those headings then became a note each builder writes before it builds, which the harness checks against what a cold viewer finds. That part belongs to Code as Proxy.

Then the page went back into production

A good document would have been the end of it. What makes this a loop is what happened next. Once all four films had cleared review, I asked what we'd learned from the reviews and the page, and specifically "what extra ideas need to go into the original prompting (not just for this [clinic] sub project)". Ten additions came back for the general brand-film skill. Two came straight off the page.

Addition 2

"Their words travel. The strongest connection device we have. What the person says early comes back inside the service's artefacts."

Addition 6

"When you can't show a result, show being understood. The rules banned before/after, and that produced better films."

The first is the device three separate builders had found on their own, which only an agent that had seen all three could name as one thing. The second turns a constraint into a principle, and it's the one I'd most want a builder working for any business that can't promise outcomes to have read.

Chapter 12's line, "making improves the explanation; the explanation improves the next making", is a claim. This is the receipt. The explanation, written from the making, became two lines of the skill that makes the next film. Chapter 18 follows those two, and the other eight, into the skill, and finds that the story of where they came from is less tidy than it looks.

What the page is evidence of

Evidence of

An agent producing a sharper account of the work after consequential attempts than the brief it started from.

That account changing the next round's prompting, in writing, for every future film.

Not evidence of

The page's quality by any independent measure. "Better" is my verdict, and I'm saying so.

Any effect on an audience. None has been measured.

Who originated its central idea. Chapter 18 shows why that matters.

One more fact, because it shows where the gate actually was. When I asked for the page, I'd told the agent to upload the films with it and add the rest as they finished. Then I stopped the upload.

"No — only final, reviewed videos that are ready."

— Me, to the build agent

So the page went live with no films on it, each marked "Coming soon". A film was added only after its repair round and a fresh round of judging, against a bar of 7 or more from every judge and no honesty gap: nothing a viewer came away believing that the film had no right to promise. The page explained the work. It didn't approve it. The review loop did that.

The page's sharpest idea, that craft has to connect to something the viewer has already noticed, didn't arrive as an idea. It arrived as a film that one judge loved and another turned down.

Key Takeaways

  • The page that out-explained my brief came from an agent that had watched a day of builds fail and get repaired, not from a better prompt.
  • Every line of it was organised around the viewer's concern and language. That's what the contrasts forced; generic marketing language couldn't account for them.
  • It went straight back into production as two lines of the general skill. "Better" is my verdict; the gate was the review loop, not the page.

Part V · One Day of Rejections, Walked

The Craft That Didn't Connect

The series' shortest film was beautiful, premium and polished, and one judge called it a masterclass. It took three repair rounds to make it fit. Each round taught a different lesson, and each lesson ended up somewhere it could check the next film.

The film's job was to stop someone scrolling. About twenty seconds, tall, built for phones, and in the page's words, "beauty first, so it works with the sound off."

The first cut delivered exactly that. Macro stills of the material being worked (resin, shape, contour, shade tabs, polish), one word on screen per cut. Then a teaching model with proportion lines, a single spoken line, "Shaped around what you'd like to keep", and an end card with the offer. It was the first of the four clinic films to finish building, and the judging ran straight away.

Three verdicts on one cut

The first cut, judged three ways
InstrumentScoreWhat it said
The judge that hears the sound (a Gemini model, as configured that day)8.8"A masterclass in quiet, premium service advertising."
The cold viewer (a persona with a small chip in a tooth, on a train, sound off)8No honesty gap.
The harsher judge (an Opus model reading keyframes and the transcript)6See below.

"The craft shots never connect to what a viewer notices, such as a chipped or short edge."

— The harsher judge, on the first cut

It had other notes: the music sat almost as loud as the voice, two dissolves left ghosted text, and the end card needed a web address a phone could read. The build agent's verdict on the verdicts took one line: "Opus's criticisms are fair, so they're the fix round."

Neither judge was wrong

Chapter 4 put the two meanings of "on brand" into two sentences. Here they are with a film under each.

Craft displayed

"Look at the sophistication of our craft."

The first cut. Material, instruments, surfaces, all beautifully lit. Nothing a viewer would recognise from their own mirror.

Craft connected

"Here is how that craft relates to the thing you care about."

What the repairs had to become. Each shot tied to something a person has actually noticed in their own smile.

The enthusiastic judge wasn't malfunctioning. It was answering the first question: is this beautiful, premium, polished? Yes. The harsher judge was answering the second: does this connect to the person watching? No. Both were real readings. Only one was the question the film existed to answer.

In the terms from Chapter 4, the craft family won and the doctrine family lost. The film was superbly made and didn't carry what this business actually offers, which is to start from what you've noticed. Chapter 4 gave the rule from The Exemplar Ratchet that decides it: a page has to win across the families, not average them. Average 8.8, 8 and 6 and you get a comfortable pass. The bar the films had to clear was 7 or more from every judge, and that one word, "every", is what stopped a beautiful film that didn't fit from shipping.

One inference of my own, labelled as that. The first cut used the clinic's own colours and type, so a brand check built on palette and typography would almost certainly have passed it. It was on brand in the shallow sense by construction. The fit question is what failed it.

Three rounds, three lessons

The repair took three rounds, not one, and the interesting thing is that each round's rejection was about something different.

One twenty-second film, three repair rounds
RoundWhat the harsher judge saidWhat the next round was asked to doLeg
First cut6. The craft never connects to what a viewer notices. Also: sound, dissolves, end card.Tie each beat to something a person sees in their own smile: shape for a short or chipped edge, contour for a worn line, colour chosen with you. Make the first frame read instantly as a tooth. Fix the sound, the dissolves and the card.Principle and artefact
After repair 1Still 6 on the main, tall cut. The scenes were "near-static tableaux in which nothing visibly changes."Make the change happen on screen: the material lands and fills the chip, the instrument carves the edge, a matte surface turns glossy under the wheel.Principle, sharpened
After repair 2The opening now "handsome, honest", the material "shown as a material being placed, carved, colour-matched and polished". Still 6, for one reason: an end card sitting static for about twelve seconds, in a film running well past its brief.Bring the film back to its length. Let the card last as long as its spoken lines plus a short hold. Change nothing else.Artefact, and a budget for every future film
Final cut7 on both cuts. Cleared the bar every film had to clear.——

Reasons are the judge's own words or the revision instructions that quoted them. Scores are given only where the story turns on them.

Round two is the one to dwell on. The first repair had done what it was asked: each beat now named something a viewer might notice. But the tools were, as the supervising agent put it in the next round's instructions, "posed, not working." A tool held beside a finished surface tells you what the service does. It doesn't show you. The instruction for round two ended with the sentence I'd put on the wall of any studio that makes things with AI:

"This round is about making the change happen on screen. That's what makes it amazing rather than handsome."

— The supervising agent, instructing the second repair

That second rejection is where the definition of "demonstrate" in Chapter 6's table came from: a change the viewer watches inside the shot, before, the service acts, after. The first rejection had said connect. The second said connect by showing a change. The distinction got sharper because the first repair satisfied the words of the first rejection without satisfying its point.

Round three looks like housekeeping, and it's easy to skip. But the film was running well past its intended length because a static end card had been allowed to sit, and that turned into a rule for every future film: a length is a budget, not a suggestion.

The card, filled in

Triage card · the craft film

  • The rejection: "The craft shots never connect to what a viewer notices, such as a chipped or short edge." Then: "nothing visibly changes." Then: a static end card.
  • Artefact leg: the shots, the sound mix, two dissolves, the end card, the length.
  • Instrument leg: the 8.8 was a real reading of the wrong question. Chapter 11's rule applies: an enthusiastic score is a prompt to instrument, not a ship decision. The cold viewer's persona already had a chipped tooth, which by Chapter 13's checklist made it a little warm; it scored 8 in every round, before and after the repairs.
  • Principle leg: craft has to connect to something the viewer has noticed, and it connects by showing a change, not by posing a tool. Condition: when the service is a making or a treatment the viewer can't see from outside. What the rejection protects: the viewer's sense that the film is about them.
  • Routes to: skill, rubric, measured facts, and a before/after pair (below).
  • Tests: the final cut passes for the stated reason; the sharpened rubric fails the first cut; the next film with a tool in it shows the tool working without being told.
  • Reopen if: films that show a change consistently read as busier and less clear to cold viewers than films that don't.
  • Accepted by: the supervising agent, on the harsher judge's reasons; its routing was later written into the general skill.

What moved into the carriers

  • Skill. "Show the change, don't pose it. A demonstration is a change the viewer watches inside the shot: before, the service acts, after." And: "Length is a budget… Nothing sits static for more than about 3 s without a reason."
  • Harness. The rubric's "demonstrate" now requires a change on screen, so a posed tool fails it. Code measures length against the budget and the static stretches, and hands those facts to the judge and the builder. (How that's measured is Code as Proxy's story.)
  • Contrasting cases. The first cut and the final cut side by side, with the harsher judge's first line and the supervisor's "amazing rather than handsome" attached.

What happened to the judge that loved it

By the end of the reviews, the judge that called the first cut a masterclass had scored every film between 8.5 and 9.7. The build agent's summary was fair to it: it "confirms the sound but can't separate a weak film from a strong one", and the recommendation was to use it only for the listening report. Why it behaved that way belongs to the sibling book.

The taste lesson isn't about that judge, though. What made the 6 valuable wasn't that it was low. It was that it came with a reason specific enough to act on, three times running, and each reason was about fit rather than finish.

The craft film's rejection was clean: one question, three rounds, a named reason each time, each ending up in a carrier. The voice rejection earlier that day was nothing like as clean, and it's the better lesson for it.

Key Takeaways

  • A film can be beautiful, premium and on-palette and still not fit. The judge that loved it was answering a real question, just not the one the film existed for.
  • Never average across families. "Seven or more from every judge" stopped a beautiful film that didn't fit; an average would have shipped it.
  • Repeated rejections sharpen the principle. "Connect" became "connect by showing a change", because the first repair met the words without meeting the point.

Part V · One Day of Rejections, Walked

The Voice: From Quality to Place

One rejection travelled all three legs in a single day: a weak voice, then checks that couldn't hear it, then a principle about who the speaker is to the audience. It took four separate events to get there, and the record doesn't match the way I first told it.

Here's the whole of the rejection, as I typed it.

"Paddock Relay is much better than expected, but for some reason that first voice is crappy compared to the rest — seems like older tech or something. Debug why, and see if we can ban that tech, or voice, or something."

— Me, on a film for one of my platform's concept companies

Paddock Relay is a farm spray-contracting concept, and its film opened on a farm manager's voicemail. That's taste at its rawest: no principle, no vocabulary. "Crappy." "Older tech." And the most honest part, "or something", which admits I couldn't say what was wrong, only that something was. Everything in this chapter is where those words went.

  1. 1Quality. "That first voice is crappy." A weak voice, found and banned.
  2. 2Perception. Our checks couldn't hear it. The builder's audition and a reading judge were both deaf to the fault.
  3. 3Relationship. The voice didn't belong. Cast the voice from the audience's place.
Chapter 7's three questions, in the order one rejection actually answered them.

Leg one: the voice itself

The cause took minutes to find. The voicemail used a local text-to-speech voice that the engine's own authors grade D+; the narrator's voice was graded A. The builder hadn't processed it any differently. The voice itself was weak. So only voices graded B- or better were allowed from then on, and anything else was refused with the reason and the alternatives. That exposed a catch: the engine had no male voice above C+.

So the farmer was recast with a different engine, given a spoken description of who he is, where he is, what he's doing and how he talks, and the best of several takes was kept. I chose that voice myself, by ear. The skill still carries my verdict on it: "perfection", "amazing".

That closed the artefact leg, and it would have been easy to stop there. A weak thing was found and replaced. Most feedback loops end at exactly this point.

Leg two: the checks that couldn't hear it

Why had the builder picked a D+ voice in the first place? Not carelessness. The skill had told builders to audition voices by comparing their pitch and checking that the transcript came out clean.

"Neither measure catches quality, so the builder picked a bad voice in good faith."

— The build agent, diagnosing the voice

Later that day the judges were calibrated against my own verdicts, and this voice was one of the test pairs: the rejected voice against the one I'd picked. The judge that read a transcript preferred the rejected voice in four runs out of four. The transcriber had misheard the gruff replacement, and the judge marked the mishearing down as bad diction. The judge that could listen agreed with me in six runs out of six, and named the thing I hadn't been able to: "an incongruous British accent".

Why judges miss what they miss is Code as Proxy's subject, and it's told there properly. For taste, the instrument leg taught something narrower, and the skill now says it twice. Once as a warning: "Pitch and a clean transcript don't measure quality, so don't audition your way around the catalogue." And once, more bluntly, as a limit: "No model can judge taste in voice or music yet. Say what you chose and why; a human listens."

Leg three: from quality to place

Look again at what the listening judge named. Not a low grade. Not "older tech". An accent, and an accent that didn't belong. Without anyone deciding it, the diagnosis had moved from how good the voice was to where it was from, and who it was talking to.

The move finished a few hours later, on a different job. When the clinic series started, the supervising agent didn't reach for the platform's default narrator. Unprompted, it cast locally, with a narrator whose accent matched the clinic's area "rather than our American house voice". It tried twelve regional voices and let a listening judge pick the narrator and the patient's voice. That's the moment I describe at the start of Chapter 10, when I found my judgment turning up in the testing.

Then, when the day's lessons were harvested, the principle got its name. It was the last of the ten additions to the general skill: "Cast the voice from the audience's place." It went into the skill with an example, and the example is the interesting part.

Cast from the audience's place. An American narrator sounds imported for a [local] clinic.

The brand-film skill, as committed that day. The place name is removed.

The fault I'd heard was a British-accented farmer. The example the skill carries is an American narrator. The principle had outgrown its origin. It isn't "no British voices"; it's "nothing that sounds imported to the people listening". That's what a rejection looks like once it has travelled all three legs: the thing it protects has a name, and the name reaches cases the original rejection never touched. Chapter 10 unpacked what the principle does and doesn't say, and Chapter 11 filled in its conditions.

One guard held, and it's worth pointing at because it's exactly where superstition would have crept in. The ban was scoped to the engine's own quality grades, not to an accent. The catalogue still includes a British-accented voice that passed on quality. The rejection was about a weak voice and then about belonging. It was never about Britishness.

The neat story and the record

Here's how I first described the whole thing, a little after the fact:

"There was a recursive loop where I rejected on taste — I'd say I didn't like that voice — and the AI interpreted it in a more general way, and we harvested everything back into prompts and a skill."

— Me, afterwards

That's not wrong. But when the development records were read against it, the story came out in more pieces.

The voice lesson: the neat story against the record
The neat storyThe record
I said I didn't like a voice.I said it was weak: "crappy", "older tech". Quality, not place.
The AI generalised it.The first fix was a ban on weak voices and a recast I chose by ear. No generalisation yet.
(Implicit: I knew what was wrong.)A listening judge named the accent, during calibration. I hadn't.
The principle came from my rejection.The local casting was the supervising agent's own initiative, on a different job, hours later.
It went into the skill.It did, named at harvest time, with an example that isn't the one I rejected.

Four events in one day, three kinds of agent and me. Not one remark, generalised.

Why tell it this way, when the neat version flatters me more? Because the messy version is the one the method predicts. Chapter 2 argued that the distinctions taste depends on are revealed by consequential attempts, plural, not extracted from one remark. And the neat version would teach the wrong lesson: that a single well-put "I don't like that" is enough to form a principle. It wasn't. It started one.

The part I haven't done

There's one more fact, and it belongs in any honest version. The clinic's voices were chosen by a listening judge. When the films went live, the build record listed what was still for me to check, and the first item was the voices: "A … listening judge chose them; you haven't heard them yet."

That's where the record leaves it. So the principle stands, and its origin is messier than the tidy version. Its application in that series hasn't been approved by the person whose ear started it. The skill's own rule says a human listens. That human is me.

Triage card · the voice

  • The rejection: "That first voice is crappy compared to the rest — seems like older tech or something."
  • Artefact leg: the voicemail's voice, graded D+ by its own engine's authors. Fixed by a ban on anything below B- and a recast chosen by ear.
  • Instrument leg: the builder's audition (pitch, a clean transcript) couldn't hear quality; the transcript-reading judge preferred the rejected voice. Revised: trust the listening judge on voices, not the reading judge, and a human approves.
  • Principle leg: "Cast the voice from the audience's place." Condition: a local service speaking to a local audience (Chapter 11 has the rest). What it protects: the viewer's sense that the speaker belongs where they are.
  • Routes to: skill (the ban, the audition warning, the casting principle with its example); harness (a listening judge for voices, my ear for approval); contrasting cases (the D+ voice against the recast; an imported narrator against a local one).
  • Tests: the recast passes my ear (it did); the listening judge prefers it (six of six). The clinic series cast locally the same day, but before the principle was written, so it doesn't test the written lesson. A successor on an unfamiliar company would (Chapter 26).
  • Reopen if: a local audience responds better to a voice that isn't local.
  • Accepted by: me, for the ban and the recast. For the principle's use in the clinic series, not yet.

By the end of the day, lessons like this were scattered across a chat, several rounds of repairs, a calibration report and a page. I asked for them to be gathered into one place. The next chapter is what came back, and what the records said when we checked it against them.

Key Takeaways

  • A raw rejection ("crappy… or something") can travel all three legs: the artefact was weak, the checks were deaf to it, and the real principle was about belonging.
  • The principle outgrew its origin: a British-accented farmer became "an American narrator sounds imported for a local clinic". Scope bans to the fault, not the category.
  • The record was messier than my first telling: four events, several agents, and a listening check on the clinic's voices that I still owe.

Part V · One Day of Rejections, Walked

The Harvest, and the Records That Contradicted It

Once the four films were live, I asked for the day's lessons to be gathered into the general skill. What came back was specific, sorted and honest about being unapplied. Then the records showed that its best idea wasn't the agents' discovery at all.

Chapter 15 quoted the question I asked once the films had cleared review. The answer opened with a sentence I'd like every retrospective to start with.

"Your review loop worked: every film improved each round, and the notes that drove the improvement point to a handful of general fixes. Nothing below is applied yet."

— The build agent, answering the harvest request

Nothing below is applied yet. A harvest is a proposal. It becomes a change only when someone accepts it, and this one knew that about itself.

What the reviews showed

It started from the evidence. The harsher judge had given seventeen verdicts across all the rounds of all four films. The agent counted which criteria it had scored under 7, and went back to what had actually been wrong each time.

Criteria the harsher judge scored under 7, across seventeen verdicts
CriterionTimes under 7What was actually wrong
Pacing12Every builder ran long. Dense four-second boards; a twelve-second static end card.
Distinctiveness10The generated imagery was "the stock vocabulary of premium cosmetic dentistry". The distinctive parts were the clinic's own things: a real portrait, the real enquiry form, its own lines.
Connection9The rubric's "connection" mixed two separate things.
Sound8The music sat almost as loud as the voice between words.
Hook, demonstrate6 eachTools were posed rather than working, so nothing changed on screen.

As recorded in the harvest, lightly generalised.

Read that table by kind, not by count, and it sorts itself. Pacing and sound are craft, and code would later measure both. Distinctiveness, demonstrate and the hook are failures of fit that no palette check could see: the films looked right and still didn't say anything only this business could say, or show anything happening. And connection isn't a failure of the films at all. It's a defect in the instrument's vocabulary, one word doing the work of two, which is how Chapter 10's split into recognition and the aha came about.

Two notes about the instruments, one line each. The cold viewer caught a commercial gap the judges hadn't: two films left viewers not knowing the price ("I'd ask about pricing on the call"). And the listening judge, as Chapter 16 showed, couldn't gate.

Ten additions, and where each came from

Then the proposals for the general skill, the one every future film on the platform is built from, written, as Chapter 9 described, as a principle, a why and a test rather than a rule.

  1. Show the change, don't pose it. From the craft film's second round (Chapter 16).
  2. Their words travel. "The strongest connection device we have." From the page, and from three builders who found it independently (Chapter 15).
  3. Say and show the offer. The price and the next step on screen for muted viewers, and said aloud for everyone else. From the cold viewer's "I'd ask about pricing on the call".
  4. Length is a budget. From every builder running long, and the craft film's third round.
  5. Size the example to the offer. "If the example is smaller than what's sold… bridge the gap honestly on screen." See the records, below.
  6. When you can't show a result, show being understood. From the page (Chapter 15); the constraint behind it is Chapter 23's.
  7. One thing only this company has. "Generated images carry mood; distinctiveness comes from the company itself." From the distinctiveness row.
  8. In a series, give each film one job in the buyer's decision, with the same next step at the end of all of them. From the page.
  9. Write the marketing note first. "It sharpens the build, and the test harness can check the note against the cold viewer's answers." From the page's four headings (Chapter 15).
  10. Cast the voice from the audience's place. From the voice (Chapter 17).

Every one of them has a traceable origin in a rejection, a comparison or the page. None of them is a rule about a clinic. Each is a statement about fit that should hold for the next business, and each carries its own reason, so a builder can tell when it doesn't apply.

And for the harness

The same answer sorted the harness changes by what they'd change. Most of them are told properly elsewhere, so here they are as a map.

The harvest's harness changes
What changesThe proposalTold in
Cold-viewer questions"Was there a moment that felt like someone like you? What detail?" and "When did you understand how it works? What did you see happen?" Graded on specificity: "a generic 'it felt relatable' fails."Here. The first question gets rewritten in Chapter 19.
The rubricSplit "connection"; make "demonstrate" require a change on screen; phrase distinctiveness as "hide the logo: name what only this company has".Chapters 6 and 10
PersonasDescribe the buyer, not the film's hook. One persona had handed the viewer the answer.Chapter 13
MethodCompare old and new cuts side by side instead of trusting absolute scores that hover between 6 and 8. Record a refusal as a refusal, not a failure.Here
Declared intent and measured factsThe builder declares its moments before the cold viewer looks for them; code measures length, stillness, whether the price is said and shown, music under the voice, the smallest text.Code as Proxy

A harvest with a kill switch

I said yes. Not unconditionally.

"Do all that, carefully. When you're done, generate a fifth video on the same topic. It seems the short videos were too difficult, so 30 to 60 seconds seemed OK. Then review how it progresses. Is the new prompting helping early? If not, stop, reset, adjust, restart. Is the new testing and judging helping? If not, stop, reset, adjust, restart."

— Me, authorising the harvest

Two things in that are doing more work than they look. The first is the length lesson, which is the craft film's three rounds turned into an instruction: the skill now says 30 to 60 seconds is the range that works, and that under about 25 is hard to land. The second is the conditions. Chapter 14 said an eloquent account is a candidate until it helps with a new case. I didn't have that sentence then, but the authorisation does the same job: it names the new case (a fifth film), says what "helping" means for each carrier, and says what happens if it doesn't.

Remember

Authorise a harvest the way you'd authorise an experiment: name the next case it has to help with, and what you'll do if it doesn't.

Then the records contradicted the neat story

Afterwards, my thinking partner read the development records alongside my account of the day, and the account changed. Chapter 14 named the two contradictions to look for, approval and provenance. Both turned up.

Approval was the voices, and Chapter 17 has told it: the clinic's local voices were chosen by a listening judge, and the record says I hadn't heard them. A high score from a listening judge isn't my yes, however well it hears.

Provenance is the bigger one. Chapter 15 asked you to hold on to a phrase from the page: what they'd change and what they'd keep. The neat story, and the one the page implies, is that the agents found it. The record of my original request says otherwise. I'd supplied a research brief with that request, and I said so plainly when the question came up:

"The original brief was supplied by me, because I knew it would be absent from the client. I generated it with AI ahead of time, from my background knowledge, what we'd already been doing, and a review of my frameworks and ebooks at that point."

— Me, on where the brief came from

And that brief, read now, already held most of what I'd been admiring in the page.

Already in the brief I supplied
  • The central question: "What would you change—and what would you keep?"
  • An audience hypothesis: "I know what catches my eye, but I don't know the dental words for it."
  • Shape distinguished from colour: "Could we look at the shape, but keep the colour close to what I have?"
  • The demonstration idea: "No 'we understand your needs' narration. We watch someone's needs becoming understood."
  • "Rapport comes from the response fitting the question."
  • A scene called "Show the human contribution surviving into planning".
  • "A demonstration explains. Evidence substantiates.", quoting my own book.
  • The audience ideas labelled "creative hypotheses to test, not findings from patient research".
  • A warning not to jump from one small concern straight to a much larger package, the seed of addition 5.
  • The advertising guidance that flags testimonials and result reveals for this kind of treatment, and a recommendation to steer clear of them (Chapter 23).
What the attempts added
  • The device: the person's words travel (onto a call-back card, into the notes, onto the design lines), found by three builders independently.
  • "Their words travel", "start in their world", "no results, no reveal": the page's compressions, sharper than the brief's paragraphs.
  • The sharpened terms: recognition, being heard, the aha, demonstrate as a change you watch.
  • The distinctions only failure could teach: craft displayed against craft connected; posed against working; a length as a budget.
  • The tests, in the rubric, the cold viewer's questions and the measured facts.

Look at the second item on the left. The page's founding line, "People don't arrive with dental words", was in the brief as an audience hypothesis, in the imagined voice of a patient. The attempts didn't originate the central ideas. They sharpened them, bounded them and made them testable.

The provenance makes the achievement clearer, not smaller.

— My thinking partner, after reading the records

I agree with that. The neat story, where the AI found the strategy in a clinic's website, is more impressive and less useful. What actually happened is a capability you can plan around: a professional's framework-informed brief carried into a new client's world, and made sharper and more concrete by production than it was when it went in. The three sources that made the films, and why it pays to keep them apart, are Chapter 20's subject.

And here is Chapter 14's point about connected derivatives, in practice. The brief, the films, the page and our discussion all agreed with each other, because each was made from the one before. The page wasn't wrong. It just didn't say where its best idea came from, and nothing in that lineage could have told us. Only the records could.

So the harvest was written, authorised with a kill switch, and corrected by its own records. Then the fifth film ran, built with the new prompting and judged with the new harness. It cleared the judges' bar on its first build. I thought it was fantastic. And I gave its opening six out of ten.

Key Takeaways

  • A good harvest starts from the evidence, sorts it by kind, gives every proposal a traceable origin and says plainly that nothing is applied yet.
  • Authorise a harvest like an experiment: name the next case it must help with, and what happens if it doesn't.
  • Read the records against the story. Here they showed the central idea came from my supplied brief; production sharpened it. That's a clearer achievement, not a smaller one.

Part V · One Day of Rejections, Walked

One Rejection, Three Legs: The Opening I Gave Six Out of Ten

The fifth film was the first built with the harvested lessons. The judges passed it on its first build. I didn't, at both ends. Following one sentence of my verdict through the film, the instruments and the principles is the clearest evidence this book has, so this chapter shows all of it, including the parts of the record that are messier than the summary.

Both of those things were true at once. The film cleared every judge. I thought it was fantastic. And two parts of it didn't work for me. The distance between those statements is this chapter.

The fifth film in the clinic series explained why a treatment plan looks at more than the one tooth you've noticed. It was the first film built with the ten additions from Chapter 18 and judged with the new harness, under the kill switch I'd written into the authorisation. The first data point looked good. The first four films had each needed at least one repair round to clear the bar. The fifth cleared it on its first build: every judge 7 or more, the cold viewer 9 out of 10, no honesty gap. That's one film, and its ceiling is "a hopeful sign that the new prompting helped early", not a finding.

Built with the harvest→My verdict, recorded as a label→Judges compared→Diagnosis→Retrofit→Truly cold test→Committed and pushed
One evening, in the order the development records give it.

The verdict

I'd already called the film fantastic and asked for it to be published as it was, with one note about the end card: "it could do with more composing IMHO — but isn't terrible". Later the same evening I went back to the opening.

"Even the opening scene could be better. I'd give it about 6 out of 10. It has a web page on an iPhone as the thing to connect on — it assumes they've seen the offer. If you met it separately, on Instagram say, it would seem disconnected."

"The rest of the video is awesome — explaining why you can't fix just one tooth."

— Me, the evening the film was built

The build agent's response was the first move of the method, and it's easy to miss because it looks like note-taking: "Recorded. Your full verdict on E gives us a clean human reference to test the judges against." A table followed: opening about 6, middle awesome, end card needs composing. Then the standard any judge would now be held to: "A judge worth keeping should find that same shape: praise the middle, flag both ends."

Then I narrowed it. "The image connects, just not the iPhone/web page. The inset image." The opening was a man on his back steps at dusk, with one line about only ever noticing one tooth. Over its first five and a half seconds, an inset phone showed the clinic's offer page. The scene worked. The inset didn't. So the label became precise: "A good judge should flag the inset, not the scene or the words."

That's the first field of Chapter 8's triage card, the rejection in the rejector's own words, filled in precisely enough to test against. Everything after this depends on that precision. "The opening's a bit off" couldn't have told a judge that got it right from one that got lucky.

What the judges said

My verdict against the judges, on the film's first build
My pointReading judge (wide / tall)Video judge (wide)
Overall8 / 78
The opening relies on prior contextPartly Hook 7 "for a retargeted viewer"; it noted that the lived detail about the viewer's smile didn't appear until about fifteen seconds in.Missed Hook 8.
The middle is the strengthYes Aha 8 / 7.Yes Aha 9.
The end card needs composingMissed Ending 8.Missed Ending 8.

The judges agreed with me where the film was strong and missed both of its weak ends. A harness that only praises correctly is half an instrument.

Notice the order, because it's the doctrine doing its job. The verdict was recorded and the judges were compared before anything was repaired. Fix the opening first and the evidence of why the harness had forgiven it would have vanished with it.

Leg one: the film

The revision brief kept almost everything. The man, the steps and his lines stayed. The middle stayed "exactly as it is". Only the inset was to go, replaced "with something from his world, not the clinic's: something a stranger scrolling Instagram, who has never seen [the clinic], recognises as their own." The end card, whose smallest text code had measured below the legibility floor for a phone, was to be composed properly. And then three words that matter more than they look: "Your call how."

The builder's call was a photo message from the man's sister: "Look at you two laughing!" It's him, laughing, with his daughter on his shoulders. The picture closes in on his laugh, and a ring settles on the one short tooth. Everyone else sees the laugh. He sees the tooth.

"Hit it out of the park — with a daddy-daughter photo, omg."

"Daddy/daughter link is super cute and always relevant."

— Me, on the revised wide cut

The tall cut was another matter. It had put the phone, photo and all, over the man's head.

"The vertical has the screen over top of the bloke's head — sort of screws the connection. There's likely room to move the screen right, or the vertical, with less space, might only be the iPhone and the photo of daddy and daughter, with no background image."

— Me, on the revised tall cut

So the artefact leg had found a second defect, and this one didn't stop at the film. (The shape of that revision brief, keeping everything except one element and composing the end card from its measurements, is Code as Proxy's example of a well-made descendant brief.)

Leg two: how we'd been telling

Three things in the harness had forgiven the opening, and a fourth missed the covered head. All four came out of that evening's records.

The judge brief. The build agent traced part of the miss to itself, and said so without being asked.

"Part of the miss is my fault: the judge brief I wrote for E says 'Where it's seen: retargeting', so the judges forgave an opening that assumes the viewer has seen the offer. Your point is that any ad gets met cold on Instagram. So the next brief change is that every film must work for someone who has never seen the offer, whatever its intended placement."

— The build agent

I'd hold that paragraph up as the instrument leg done honestly. It names its own contribution to the miss, says what my rejection actually meant, and turns it into a rule about every film rather than a patch on this one.

The persona. The cold viewer had been given a persona, and it wasn't cold. The fix changed one clause.

Primed

"A woman in her forties…, scrolling Instagram in the evening, who has seen [the clinic's] packages advertised and wondered whether something like that is for her."

Truly cold

"A woman in her forties…, flicking through Instagram in the evening, who has never heard of [the clinic] or its packages, and has idly wondered about fixing a front tooth that bothers her in photos."

Here's what the two personas said about the two openings, every run, in the order they ran. I'm showing all seven because the tidy version is in the build agent's summary, and the runs are not tidy.

Seven cold-viewer runs on the fifth film's tall cut, in order
RunViewerOpeningRecognitionIn the viewer's words
1PrimedOld (inset)Specific"It was the words that got me, not the person."
2Truly coldOldSpecific"The person on screen was a man seen from behind, so he didn't feel like me, but the words did."
3Truly coldOldPartial"The picture didn't feel like me. It was a man with his back to the camera looking at his phone."
4PrimedNew (photo)Partial"I kept waiting to see a woman my age and never did."
5Truly coldNewPartial"I got the idea, but I was relating to the line, not the person."
6Truly coldOldPartial"I'm not him, and I'd never have been on a … offer page. I'd just be scrolling Instagram."
7Truly coldNewSpecific"Instead of enjoying it you zoom in on your own mouth. I have absolutely done that."

From the judging records; place names and treatment names removed. The question and its grading were being reworked while these ran, so read the words, not only the grades.

Read the answers rather than the grades and the second defect in the harness is obvious. Five of the seven are about whether the person on screen looked like the viewer. That's the question's fault. It asked whether there was a moment "you thought 'that's me' or 'someone like me'", and a woman in her forties, shown a man, answered the question she was asked.

7

Cold-viewer runs on the fifth film's tall cut, across two personas and two openings

5

Answers that turned on whether the person on screen looked like the viewer

1

Answer that rejected the old opening for its situation, not its casting: my verdict, in a stranger's voice

The question. So the question was rewritten to ask about the viewer's own life, "even if the person on screen isn't like you", and the grading was rewritten with it. The new grading rule is worth quoting whole, because of where its example came from:

"Recognition is of a situation, not of a look-alike: a viewer of another age or sex recognising the moment (a photo someone sends, the tooth you always look at) is picture 'yes'; 'a bloke, not me' alone is not a miss. Take the viewer's qualifiers seriously when they are about the situation ('I'd never be reading a clinic's web page' is picture 'no')."

The judge's cold-viewer grading, as committed that evening.

That last example reads like run six's sentence, lightly generalised. As far as I can tell from the records, a viewer's words became the grading rule. Now read the table again under it. Runs two to five are look-alike complaints, not misses. Run six is the only answer about the situation, and it's my verdict, in a stranger's voice. Run seven recognises the new opening as a situation that was hers. And run one, the primed viewer, had no reason to find the offer page foreign, because she'd been told she'd seen it.

"Instead of enjoying it you zoom in on your own mouth. I have absolutely done that."

— A truly cold viewer, on the new opening

One honest note about the record itself. The build agent's summary, and the skill's own account of the case, tell this more cleanly than the runs do: one truly cold viewer, one verdict per opening, the primed viewer passing both. The skill even attaches "I was relating to the line, not the person" to the old opening; in the runs, it was said about the new one. Chapter 14's rule applies to the harness's own history as much as to anyone's story. The records win. The summary's direction holds; its tidiness doesn't.

The rubric. The fourth was the covered head. Neither main judge had named the phone over the man's head in the tall cut. After the rubric was tightened to cover "a person's face or head, even seen from behind", the judge found a real flaw on the revision's tall cut, a label running across the top of his head at 0:39, which the builder's tall-only fix had already moved. On the opening, it now said the cut "layers what a wide frame would… then a card over the photo", which is my "needs to attempt less" in its words. It still never said in so many words that the phone covered his head. The build agent wrote that down as "the one miss left". Meanwhile the main judges' recognition scores for the opening rose from 7 to between 8 and 9 on the new cut: the instrument and the artefact moving together, and measured.

Leg three: the skill had caused it

When the build agent traced the covered head, the trail didn't end at the builder. It ended at the skill. The skill's advice for tall cuts had said "the card sits over the quiet part of the scene", "which is how E's phone landed on his head." The principle was wrong, not just the film.

The same was true, more quietly, of the other two instruments. The question's "someone like me" had a principle built into it, that recognition means resemblance, and the brief's placement note had one too, that a viewer who's been retargeted can be assumed to know things. Both were wrong in a way that let a disconnected opening through.

"So how do we retrofit the lesson into the prompting? The vertical has less real estate, and needs to attempt less — especially the opening scene."

— Me, to the build agent

The answer was Chapter 9's three carriers, described from practice rather than theory; I quoted it there. Here is what it actually changed.

Before and after: what one rejection changed in the skill and the harness
WhereBeforeAfter
Skill · tall cuts"One thing at a time, and big. A phone shows one idea per moment. Stack the person and the product instead of placing them side by side: the scene fills the frame and the card sits over the quiet part of it, or the scene takes the top half and the card the bottom.""Attempt less, especially in the opening. The tall frame has about a third of the wide frame's width. Keep every beat and every word, but not every layer. For each moment, pick the one element that carries it and drop the rest, and the opening most of all."

"Never cover the person or the subject. A card, a caption or an overlay over someone's face, or over the thing the scene is about, breaks the connection. If there's no empty part big enough, drop the background instead of shrinking the subject."

"Stack the person and the product rather than layering them… or the card sits over a part of the scene that really is empty."
Skill · recognition—"Anchor on the human link. The company's material can come in second, and light." With the revised opening as its example, in my words.
Skill · checkingFor the tall cut: check that each scene shows one thing, big.Also: "check that nothing covers a face or the subject"; "check that the opening attempts less than the wide one". And: "Always run one truly cold viewer: a persona who has never heard of the company or its offer, scrolling a feed."
Harness · cold question"Was there a moment you thought 'that's me' or 'someone like me'? Which detail, and when?…""Was there a moment you recognised your own life: something you've done, seen or felt, even if the person on screen isn't like you? Which detail, and when?…" Words and picture graded separately; the situation, not a look-alike.
Harness · rubric—"In a tall (9:16) cut the frame holds one thing at a time: a card, caption or overlay covering a person (their face or head, even seen from behind) or the subject of the scene breaks the connection (name it and its time); an opening that layers as much as a wide frame would is attempting too much."
Harness · brief"Where it's seen: retargeting in social feeds… and on the offer page next to the packages."Every film must work for someone who has never seen the offer, whatever its intended placement.
Code—A source reader lists every card and text box per scene, so covering can be checked rather than guessed.
Contrasting cases—My verdicts recorded as test labels (the opening about 6 because of the inset; the middle awesome; the end card needs composing; the new wide opening excellent; the new tall cut covers the person), and the two openings kept side by side.

Quoted from the brand-film skill and the judge as committed that evening; clinic details removed.

Look at the conditions in the new text, because that's where Chapter 11's guard shows up. Tall cuts attempt less than the wide one, not less in general. The company's own material isn't banned from the opening; it comes "second, and light". The lesson carries its scope with it.

Where it went

By the end of the evening, everything was committed and pushed, with nothing forced, and the brand-film skill was on all twelve company boxes. The film agents inside them pick it up on their next film task, with no restart. The lesson now sits where a builder working for a different company, in a different world, will read it before it builds. Whether it helps there is the successor test, and that's Chapter 26.

The case, read against the doctrine

What Parts I to IV claimed, and what happened here
DoctrineIn this case
Triage before you fix (Chapter 8)The verdict became a label and the judges were compared before the opening was touched. Otherwise the evidence that the brief and the persona had forgiven it would have gone with the old opening.
Three questions (Chapter 7)Make: a better opening. Tell: the brief, the persona, the question, the grading and the rubric. Say: attempt less in the tall cut, never cover the person, anchor on the human link.
Judgment on both sides (Chapter 10)The same distinction went into the skill ("attempt less") and the rubric ("an opening that layers as much as a wide frame would is attempting too much").
The superstition guard (Chapter 11)The new principles carry conditions: less than the wide cut; company material second and light, not banned.
The cold reviewer (Chapter 13)The primed persona was the checklist's second item failing live, and the look-alike question was its fourth.
A candidate, not doctrine (Chapter 14)The new principles are dated, tied to one film, and waiting for a successor. And the harness's own tidy record of the case was corrected by its runs.

Why this is the evidence the book rests on

One human verdict, a few sentences about an opening, became three things. A better film, which I approved. A harness that now asks the right question of a truly cold viewer, reads its answers by situation rather than resemblance, and has a written note of the one thing it still misses. And principles stated precisely enough, with their conditions, to change the next film for a different company. All of it is dated, all of it is in the record, and the skill text is quoted before and after. If this book's claim is true anywhere, it's true here, and you can check it.

Triage card · the opening I gave six out of ten

  • The rejection: "It has a web page on an iPhone as the thing to connect on — it assumes they've seen the offer." Narrowed: "the image connects, just not the iPhone/web page. The inset image."
  • Artefact leg: the inset, replaced with a photo from the man's own life; the end card composed from its measurements; then the tall cut's covered head.
  • Instrument leg: a judge brief that licensed assumed context; a primed persona; a look-alike question; a rubric that couldn't see a covered head. All four revised; one miss written down.
  • Principle leg: anchor on the human link; attempt less in the tall cut; never cover the person. Conditions: less than the wide cut; company material second and light. What it protects: a stranger's first seconds, met cold.
  • Routes to: skill, rubric, cold-viewer question and grading, judge brief, a source reader in code, and my verdicts as test labels.
  • Tests: the new opening passes my verdict (the wide cut did); a truly cold viewer recognises it as a situation (run seven); the revised rubric catches a covered head (partly); a successor on another company attempts less in its tall opening without being told (Chapter 26).
  • Reopen if: truly cold viewers consistently recognise an opening that depends on the offer, or tall openings that attempt less lose them.
  • Accepted by: me, for the film and the principles. Committed and pushed the same evening.

That's the method working for a business whose owner never had to explain their brand. They couldn't have, and nobody asked them to. The next part takes that case head on: what to do when the client can't brief you at all.

Key Takeaways

  • Record the verdict as a label and compare the judges before you fix anything; the evidence of why the harness forgave the work disappears with the fix.
  • One rejection exposed four instrument defects (brief, persona, question, rubric) and one wrong principle in the skill. The film was the smallest of the three repairs.
  • Read the runs, not only the summary. Here the raw answers were noisier than the tidy account, and a stranger's own sentence seems to have become the grading rule's example.

Part VI · When the Client Can't Brief You

The Brand Guide That Doesn't Exist

Most of the businesses that most need judged work can't tell you what their brand is. Asking them to fill in a questionnaire asks them to do the work they're hiring you for. The way through is to show them something, and to keep careful track of who supplied what.

Looking back on the clinic films, one thing struck me that had nothing to do with film.

"A small business generally isn't run by an experienced marketing professional. If you ask them what's your brand guide, what's your language, what's your brand promise, they wouldn't know. It's absent."

— Me, after the clinic films

That isn't a criticism of anyone. It's the normal case. The people running a small practice are good at the practice. They've never had to write down who their customer is, what they promise them, or how they sound, because nobody has ever asked, and the business works anyway. Chapter 4 quoted a large vendor's admission that even brand guidelines running to hundreds of pages "never go far enough". The businesses that most need help don't have the hundreds of pages. They don't have the history of approvals and rejections those systems learn from, either.

What the usual workflow assumes

The conventional creative workflow starts from a brief the client supplies: the audience, the brand promise, the tone of voice, what makes them different, what the campaign is for. My thinking partner put the problem with that plainly when we talked it through: "Asking the owner to complete a sophisticated brand questionnaire may amount to asking them to perform the professional work they need help with."

I'd made the same point from the other side in The Manila Folder, about helping people discover what they might want to do: "We don't need to understand someone completely before showing them something — showing them something can help us understand them." And its warning about the alternative: "Questionnaires produce false clarity: neat fields, wrong fit."

Requirements engineering has had a name for this for a quarter of a century. "I'll Know It When I See It (IKIWISI). Requirements often emerge only after users have had an opportunity to view and provide feedback on models or prototypes."3 And practitioners building AI evaluations say the same about domain experts, whose expectations are ones "they might not be able to fully articulate upfront" until they're judging real outputs.19 If people with a profession can't state their standard in advance, it's unreasonable to expect it of a business owner who has never been asked.

Instead of requiring the client to supply a finished brand strategy, the system uses informed judgement to develop a concrete candidate they can recognise, correct and approve.

That's the relationship change, and every chapter in this part hangs off it. The client stops being the source of the brief and becomes the judge of a candidate. That's a job they can actually do.

Three sources, kept apart

If the client isn't supplying the brief, something else is. In the clinic's case there were three sources, and the records only made sense once we separated them.

Three sources of knowledge when the client can't brief you
SourceWhat it contributesIn the clinic's case
The client's material"The advertised offer, public claims, visual identity and available details about the service."The offer page, the website, the real enquiry form, the practitioner's photo and registration.
The professional's framework-informed brief"The questions worth asking, the audience hypotheses, the communication principles and the standard of acceptable work."The brief I supplied, generated with AI from my own frameworks, with the central question already in it (Chapter 18).
The production and review process"Concrete expressions, failures, comparisons, implementation discoveries and sharper explanations of what the principles require."Their words travelling; posed against working; the length budget; casting from the audience's place; the tests.

The middle column is my thinking partner's wording, after reading the development records.

Keeping them apart isn't bookkeeping for its own sake. It "prevents a misleading account in which the AI somehow discovered the whole strategy in the website". That's exactly the account I'd have told if the records hadn't been read against it: the central idea looked like a discovery of the third source, and it came from the second.

What transferred

Here's the part I believe most strongly, and it's the reason this book is about taste rather than templates.

"What transferred was your way of thinking about communication — not just a successful video template."

— My thinking partner, on what carried into the new client

The follow-on sentence is the distinction: "A template carries a previous answer. Your contribution helps the system decide which questions a different client needs answered." A template from the concept films would have given the clinic a film shaped like the concept films. What actually carried was a set of questions: what does this viewer already handle, what would they recognise, what can be shown rather than claimed, what can't be promised. Those questions produced different answers for a different business, and that's the point of them.

"It's leveraging my contribution into a new client environment and a new brand, and exploring that brand in a more rigorous and organised way — even when it isn't being supplied."

— Me, after the clinic films

Two passes, and the one that can't be loaded

In Worldview Recursive Compression I described two stages in making anything with AI that sounds like you: "There are TWO compilation passes, not one. Skip the first, and you're stuck nursing outputs." The first pass compiles the professional into the builder: your frameworks, constraints, voice and standards. The second applies that builder to a client's context to produce the work.

The clinic case adds something to the second pass. Its input, "client/project context", was written as though it were a document you load. When the client can't brief you, it isn't. As my thinking partner put it, "the client-specific context is not fully available at the beginning. Some of it has to be developed through the work." The second pass has an input that production has to write. That's the next chapter.

"They should just hire a brand strategist"

Some should. Many won't, and some can't. And even a good strategist does better work with something to react to than with a blank sheet. In Demonstrate Over Tell I argued that an open "why?" is a recall task and a set of offered options turns it into recognition, which people can do in seconds. The line I'd give any strategist: "A system that can't take a 'no' cheaply can't learn what 'yes' means." A concrete candidate is the cheapest way to get a client's "no", and their "no" is where their brand starts to become visible.

Tag every claim with its source

The operating habit that makes all this safe is small. Every claim in the working brief gets a source and a status. It's the told-versus-revealed record from Chapter 3, with one more column, for the client.

Three-source tagging: the working brief, row by row
ClaimSourceConfirmed by the client?Where it lives now
The next step is a request for a call, not a bookingClient material (the offer page)Yes: it's their pageEvery end card
Viewers arrive without the clinical words for what they've noticedProfessional brief (an audience hypothesis)Not yetThe page; the films' openings
What the person says early turns up later, in the notes and the planProfessional brief (the idea); production (the device, found by three builders)Not yetThe skill; the films
The voices sound localDiscovered in production (the supervising agent's casting)Not yet, and not yet by meThe skill; the films

Shape Four rows from the clinic case, generalised. Date every row when you use it. "Not yet" is the most important entry in the table: it's the list of things to show the client.

Two things fall out of keeping this table. The first is honesty about provenance, the thing Chapter 18 needed the records for. The second is a to-do list. Every "not yet" is a claim about the client's business that nobody from the client has seen. Chapter 23 turns that list into the thing you show them.

Bottom Line

No brand guide doesn't mean no brand work. Production can be the instrument that writes the brand guide, as long as you keep track of who supplied what.

But "production can write it" is only true if production is looking. If some of the client's context has to be developed through the work, the work needs a way of developing it on purpose rather than by accident.

Key Takeaways

  • For most small businesses the brand guide doesn't exist, and a questionnaire asks them to do the work they need help with. Show them a concrete candidate instead.
  • Keep three sources apart: the client's material, your framework-informed brief, and what production discovers. Mixing them produces the story where the AI "found" the strategy.
  • Tag every claim with its source and whether the client has confirmed it. The "not yet" rows are what you show them next.

Part VI · When the Client Can't Brief You

Brand Development Through Production

Making a film of a vague promise forces the promise to become specific. The gaps it exposes are of three different kinds, with three different owners, and the characteristic mistake is to treat them as one.

"We provide personalised care." Every service business says it. It can sit on a website for ten years without anyone asking what it means.

Try to film it and the sentence stops working. A camera can't point at "personalised". It has to point at something, and so the production question arrives, whether anyone planned to ask it or not.

What would the viewer actually see happening that makes this care personal?

Nobody can answer that with a synonym. The answer is a scene: a person says what they'd like to keep, and it turns up later in the plan. Or the answer is a silence, and the silence is information. My thinking partner listed where it points: the question "can expose a hole in the script, a hole in the brief — or a hole in the service's own account of what it does." Three holes, three owners. The builder owns the script, the professional owns the brief, and only the client can say what the service actually does.

Key Insight

The video becomes an instrument for making the business more explicit.

"Filling gaps" is three different jobs

Once production starts exposing holes, it's tempting to fill them all the same way: write something plausible and move on. That's where most of the damage in this kind of work gets done, because the holes aren't the same kind of thing.

Three kinds of gap, and what closes each
GapExampleWho can answerWhat counts as closing itWhere it lives afterwards
Already true, but unarticulated"How the clinic actually handles a hesitant enquiry."The client. Only they know.Recovered and confirmed: they recognise it, or correct it.The brief, as fact, with who confirmed it and when.
A choice not yet made"Which aspect of the service the campaign should lead with, or which voice best expresses the intended relationship."Nobody yet. The professional designs options; the client chooses.A decision, made by the person entitled to make it.The brief, as a decision, with its reason.
A hypothesis about the audience"What concerns people most, what attracts attention, or what makes the first step feel manageable."Neither of them. Only the audience.Evidence from people responding. Not a convincing story.The test plan, labelled as a hypothesis until then.

The three kinds and their examples are my thinking partner's, from our discussion of the clinic records.

The rule that matters most is in the last row. Hypotheses about the audience "need testing rather than being promoted into facts because the story sounds convincing." That's the characteristic mistake of a persuasive account, and a supervising agent that explains beautifully (Chapter 12) is exactly the kind of writer that makes it. "A good system can work with all three. It should not treat them as interchangeable."

That's why I'd call this brand development through production, not brand extraction. Extraction assumes the brand is in there somewhere, waiting to be found in the website and the owner's head. Development admits that some of it doesn't exist yet: choices nobody has made, and guesses about the audience nobody has tested. The verb matters, because "extract" licenses you to present what you wrote as what you found.

Why the owner can't just tell you

The first kind of gap is the one that looks like it should be easy. It's already true. Just ask. The sociologist Harry Collins explains why asking doesn't work, in a taxonomy of the ways tacit knowledge stays tacit. A review of his work summarises the relevant kind as knowledge that "could be made explicit… but is not made explicit", and names its sub-forms.26

Collins's tacit knowledge, mapped to the client's gaps
Collins's formAs the review puts itWhat it means here
Unrecognized knowledge"The kind of knowledge an individual possesses but doesn't recognize themself as important to the work at hand."Why the owner never volunteers how they handle a hesitant caller. It doesn't feel like brand. It feels like Tuesday.
Ostensible knowledgeKnowledge that "requires the use of an object that a learner can interact with in a guided way".The draft film is that object. The owner reacts to it, and what they know comes out as a correction.
Mismatched saliencesOne side works from an assumption about the other's possession "of some essential piece of explicable knowledge".The professional assumes the owner knows a detail matters; the owner assumes the professional already has it. Neither mentions it. (The next chapter's subject.)

And the second kind of gap, the choice not yet made, is Schön's point from Chapter 2 applied to the client: "An evolving intention is one of the outputs" of designing.2 A client often doesn't know which part of their service to lead with until they see it led with.

Filling is fine. Knowing what you're filling is the job.

I'd noticed the system doing gap work before I had any of this vocabulary.

"As the system works on the brand videos, it works out there are holes — and it's filling up the gaps as well."

"It's a crazy level of autonomy — trying to work out brand, the things that are explicit and the things that are implicit. It's really quite astonishing."

— Me, after the clinic films

Both of those are true, and the second is still how I feel about it. But the discipline is in the word "filling". Filling a hole in the script is the builder's job and nobody minds. Filling a hole in the service's own account, and presenting the filling as fact, is how a film ends up promising something the business doesn't do. The records from that day have a specimen of each kind handled well.

  • A hypothesis, labelled as one from the start. The brief I supplied called its audience ideas "creative hypotheses to test, not findings from patient research" (Chapter 18). That label is the third row of the table, correctly filled in before a single film existed.
  • A choice, designed through production. The same brief warned against jumping from one small concern to a much larger package. After review, that became a principle for the skill, "size the example to the offer", with the instruction to "bridge the gap honestly on screen". The choice of how to bridge it was made in the films, where it can be seen and judged rather than argued about.
  • Something already true, made visible. The fifth film's middle, the part I called "awesome", explains why you can't treat just one tooth. That reason was already true clinically. The film's job was to make it visible to someone who'd never been told (Chapter 19).

The method: tag every claim before anyone shows it

Claim tagging, for any film, page or proposal about a client's service

  1. List every claim the draft makes about the service, the explicit ones and the ones implied by what's shown. A scene of a note being taken is a claim that notes get taken.
  2. Tag each one: already true · choice not yet made · audience hypothesis · unknown.
  3. Send the already-true items to the owner as questions, with the relevant moment of the draft as the prompt: "Is this what happens when someone rings unsure?"
  4. Send the choices to the owner as options, with the draft showing one of them, so they're choosing between things they can see.
  5. Put the hypotheses in the test plan, and keep them labelled as hypotheses in the brief until people have responded.
  6. Leave unknowns visibly unknown. Nothing is shown as fact that nobody has confirmed. Chapter 23 draws that line precisely.

The tag also tells you which of Chapter 20's three sources a gap needs. Already-true gaps need the client's knowledge. Choices need the professional's design and the client's decision. Hypotheses need the audience, which is the one source no amount of production can stand in for.

All of this assumes you can see the gaps in the first place. Most of the real work is noticing them, and what gets noticed as missing depends on whose judgment is doing the looking.

Key Takeaways

  • Filming a vague promise forces the question "what would the viewer actually see?" The answer exposes holes in the script, the brief or the service's own account.
  • Three kinds of gap: already true (the client confirms), choices (the client decides between designed options), audience hypotheses (only the audience can settle). Never promote a hypothesis because the story sounds convincing.
  • Tag every claim before the draft is shown. The draft is the object that lets the owner's unrecognised knowledge come out as a correction.

Part VI · When the Client Can't Brief You

Teaching the System What to Notice as Absent

When the client can't brief you, the professional's most valuable contribution isn't an answer. It's the list of what's missing. Two readers can inspect the same material; only one of them sees the gaps that matter.

Here's the sentence from our discussion of the records that I'd put at the centre of this part of the book.

Your expertise is influencing more than the answers. It is influencing what counts as an unanswered question.

— My thinking partner, after reading the development records

Picture two readers going through the same client's material: the website, the offer page, the enquiry form, the practitioner's photo. The first has no particular framework for communication. They "see enough to begin: offer, price, logo, colours, contact form." Everything a production needs is there. The second reader carries a way of thinking about how a film connects to a person, and sees something else entirely: a set of questions the material doesn't answer.

What the first reader sees is missing

Nothing much. Maybe a better photo. The fields are filled: offer, price, logo, colours, contact form.

What the second reader sees is missing

"What would make the viewer recognise themselves? Where does their question affect the response? What makes the offer understandable rather than merely visible? What should distinguish this clinic from generic premium-dentistry imagery?"

None of the second reader's questions can be answered by finding a document. That's the point, and it's worth stating exactly.

Key Insight

Those are not missing fields in a database. They are missing relationships in the proposed experience. The professional's judgment is teaching the system what to notice as absent.

That reframes what the autonomy I was so struck by actually was. The system wasn't only "completing assigned production steps". It was "identifying prerequisites for doing the work well and proposing ways to satisfy them." Where the prerequisites came from is the question, and the honest answer is: from the judgment it was carrying. "The AI filled in the gaps" is the flattering description. "The professional's judgment decided which gaps existed" is the accurate one.

The absence nobody had named

The clearest example from the day is one Chapter 18's table already showed. In ten of the harsher judge's seventeen verdicts, distinctiveness scored under 7. The generated imagery was, in the judge's phrase, "the stock vocabulary of premium cosmetic dentistry". The distinctive parts were the clinic's own things: a real portrait, the real enquiry form, the clinic's own lines.

That's an absence nobody had written down: nothing in these films is only theirs. It didn't show up as a missing field. The films had a logo, a palette, an offer. It showed up only when a judge was asked a question about distinctiveness, repeatedly, and kept failing the same thing. What it teaches is simple once it's said. Generated material supplies the mood of a category. Distinctiveness has to be found in the company itself.

The hide-the-logo test

Cover the logo and the name. What's left on screen that no competitor could have shown? A real person, a real form, a phrase the business actually uses, a way it actually does something. If the answer is "nothing", the film is advertising the category.

As it went into the harvest: "One thing only this company has. Real people, real forms, their own words. Generated images carry mood; distinctiveness comes from the company itself." And into the judge's rubric: "hide the logo: name what only this company has".

My thinking partner was careful to call that "a recorded interpretation of the review rounds" that "became a proposed general principle", and that's the right status. It's a candidate, supported by one series. And the further claim, that viewers would actually understand or respond better to the distinctive version, "still requires audience evidence." The absence was noticed. Whether filling it helps is a separate question, with a separate kind of answer.

Remove the contribution, and see what disappears

There's a test I wrote for a different purpose that turns out to be exactly the right test here. In Made From You, about companies built around one person's expertise, the claim was that "your understanding affects what the company notices, which questions it asks, how it interprets a request and when it refuses an easy answer." And the test for that claim: "Changing the colours, biography and tone of a standard offer does not establish that claim… The useful question is what would change in an actual piece of work if your contribution were removed."

Run it in both directions. For the client: hide the logo, and what remains that's only theirs? For the professional: remove my brief, and what would the system no longer have noticed? From the records, the honest answer is the central question (what would you change, and what would you keep?) and the demand that a person's preferences survive into the planning. Those were mine, and the films were organised around them (Chapter 18). Without them, my guess is that the builders would still have made competent films, and more of them would have looked like Chapter 16's first cut: craft displayed rather than connected. As I put it in the same book, "your practical distinctions shape its decisions." Here the distinctions shaped what counted as missing.

This is also where Chapter 21's mismatched saliences get resolved. An owner is unlikely to see their enquiry form as distinctive; to them it's a form. The professional can. Noticing absence is resolving a mismatched salience in the client's favour: seeing that the ordinary thing they do is the thing only they have.

Absence prompts

If the professional's contribution is a way of noticing what's missing, it can be written as questions any system can ask of any client's material. These are mine, from the films. Yours will differ, and should.

Seven absence prompts for a client's material

  1. Where does the customer's own situation appear, in their words? Not the business's description of them.
  2. Where does the customer's question change what the service does? If nowhere, the promise of personal service has no evidence.
  3. What would someone have to already know for this to make sense? Chapter 19's opening, generalised.
  4. What here could any competitor say or show? Strike it, and see what's left.
  5. What's the one thing only this company has, and is it on screen? The hide-the-logo test.
  6. What does the service promise that we can't yet see it doing? Every promise needs a moment that shows it.
  7. What's missing that the owner wouldn't think to mention? Ask about ordinary moments: the first call, the hesitant enquiry, the follow-up. That's where the unrecognised knowledge lives.

Run two of them against the clinic's own material and you can see how they work. Prompt four first: what here could any competitor show? A macro shot of resin, shade tabs, a gloved hand holding an instrument, a polished surface. Strike all of that and very little of the generated imagery survives, which is exactly what the harsher judge kept finding. Now prompt five: what's the one thing only this company has? The clinic's real enquiry form was one answer. Its question, "What would you most like to discuss?", is the business speaking in its own voice, at the exact moment a hesitant person decides whether to ask. A film that opens on that form starts in the viewer's world and in the clinic's at once. Nobody briefed it as a brand asset, and an owner is unlikely to think of their enquiry form as one. The prompt is what turns it from a field into a relationship.

One rule goes with them. When a prompt finds nothing, record that as a finding, not as a gap to paper over. "We found no moment where the customer's words change anything the service does" is a fact about the material, and a useful one. It goes to the client as a question: is this something you do and haven't said, or something you don't do? It doesn't go onto the screen as an invention.

That last sentence is harder to keep than it sounds, because noticing an absence creates a temptation. A system that can see a consultation that listens is missing can also draw one, beautifully, whether or not the clinic's consultations work that way.

Key Takeaways

  • The professional's contribution when the client can't brief is a way of noticing what's missing. The gaps that matter are missing relationships, not missing fields.
  • Generated material supplies category mood; distinctiveness has to be found in the company. Hide the logo and ask what's left.
  • Write your noticing as absence prompts. When one finds nothing, record the absence as a finding and ask the client. Don't invent it on screen.

Part VI · When the Client Can't Brief You

Developing the Brand vs Inventing the Business

A system good at filling gaps can fill them with things the business doesn't do. The line between developing a brand and inventing a business is the honesty boundary of this whole method, and the proposed film turns out to be the best instrument for holding it.

The sentence that draws the line is short, and I'd like every agency using AI to have it pinned somewhere.

"It can propose that the clinic should visibly preserve a patient's preferences. It cannot establish, from a generated consultation scene, that the clinic already operates that way."

— My thinking partner, on the next boundary

The same goes for every service moment a film can draw. A call-back sequence, a planning note, a clear explanation of fees: each "may be an excellent communication design. Whether it faithfully describes the clinic's actual process remains a separate question." And the line gets more important, not less, as the tools improve: "The more capable the system becomes at filling gaps, the more important this distinction becomes." Inventing the business isn't the failure of a weak system. It's the characteristic failure of a good one.

A demonstration explains

The rule I use for this is from Demonstrate Over Tell, and it was already in the brief I supplied for the clinic, before any film existed: "A demonstration explains. Evidence substantiates." The book spells out what that means: "A demonstrated moment shows what something is like. It is not proof that it happens reliably, or at all." And the version I'd put in front of anyone tempted to film a service moment the client hasn't confirmed: "A demonstration of a feature that doesn't exist is a misrepresentation with good typography."

Applied to generated media, the consequence is blunt: "A generated demonstration is not evidence of reliable service delivery." A beautifully listening consultation, drawn by a model, is evidence that the model can draw listening. It says nothing about the clinic.

Not a reason to retreat

The obvious overreaction is to stop showing service moments at all and go back to the generic ad: logo, smiling person, offer, phone number. That throws away the most useful thing the process makes. The proposed film has a second use, and it's the one this part of the book has been building towards.

Show the clinic the proposed experience and ask which parts accurately represent its practice, which need correction, and which it would like to adopt.

"Now the client does not have to manufacture a brand guide from a blank page. It can exercise judgement over a concrete account of its service." That's the questionnaire problem from Chapter 20, solved from the other end. The owner who couldn't tell you their brand promise can certainly tell you, watching a scene, "we don't do that", or "yes, that's exactly what we do", or "we don't, but we should".

In Specimen, Not Prescription I drew the line between a demo that closes listening and one that opens it. The specimen line says: "Here is a working specimen of the consulting model I'm describing. It proves the method exists. Discovery determines whether, where and how it applies to you." Its value is the resistance it invites: "Adversarial contact with a concrete object is higher-resolution than polite agreement with a vague sentence." The proposed film is a specimen of the business, shown to the business. Every "we'd never say it like that" is information about the service itself, the kind a questionnaire never gets.

The client review sheet

Client review sheet: the proposed experience

Status: proposed. I haven't yet run this with the clinic. It's the next step, and it's here because the method needs it, not because it has been proven.

Moment in the proposed experienceRepresents our practiceNeeds correctionWe'd like to adopt thisEvidence it happens
The first response to an enquiry☐☐☐
The note taken in the consultation, in the person's words☐☐☐
How the options are explained, including fewer or none☐☐☐
The explanation of fees☐☐☐
The follow-up☐☐☐
Any claim about care☐☐☐
  • Represents our practice: keep it. It's now an explicit brand commitment, with an owner.
  • Needs correction: record what actually happens, in their words. The film changes to match.
  • We'd like to adopt this: that's a service change. The film waits until it's true.
  • Evidence it happens: who could confirm it, and what a customer would notice if it's true.

How to run it matters as much as the sheet.

  • Walk the moments in order, with the draft playing. The owner is reacting to a scene, not recalling a policy.
  • Ask for a mark per moment, not an overall opinion. "Looks great" is the answer a sheet exists to prevent.
  • Record corrections verbatim. They're the most valuable output of the session. They are the brand, arriving.
  • Don't let "adopt" become "publish". A commitment the business likes and hasn't implemented is a plan, not a fact.

There's a family resemblance here to a method I described in Experience Is the Unit, where you write the review you'd be proud to earn and work backwards from it. The warning there applies exactly: the target is not a script. "Their actual feedback must be free to contradict the design target." And "the most useful review is not necessarily the most enthusiastic." A review sheet that comes back with every moment marked "represents our practice" and no corrections hasn't been read. It's been signed.

Both directions

Service → film

"The actual service constrains what the film may honestly show."

Film → service

"The film can make a desirable service commitment explicit enough for the business to adopt."

My thinking partner's summary of what that means: "That is brand work becoming connected to service design." The valuable outcome "is therefore not simply a better marketing surface. It is a clearer agreement about what the business intends customers to experience." I think that's the most underrated thing in this book. A small business that can't write down its brand promise can end up, via a film it never asked to be the source of, with its brand promise written down, corrected by the owner and true.

When you can't show a result, show being understood

The clinic case came with a hard version of the honesty boundary, and it's worth telling because the constraint made the films better.

In Australia, advertising for higher-risk cosmetic procedures is tightly regulated. The national guidelines say such advertising "must not use testimonials due to their potential to create unrealistic expectations of beneficial treatment." Before-and-after images "may create unrealistic expectations", and where they're used at all they must be genuine images of actual patients treated by that practitioner, unedited, and carry a prominent warning.27 A generated film can't show a result at all. There's no real patient in it to show.

The brief I supplied had already flagged that direction, and the films took it seriously. Chapter 15 quoted the page's answer: no results, no reveal, because such shots "also make weaker films, because they promise an outcome nobody can promise." The films showed the care and the process, and ended "with the person just as they began." At harvest the constraint became a principle for every future film, whatever the industry: "When you can't show a result, show being understood."

One boundary on my own claim. I'm not saying any of these films was reviewed for regulatory compliance; that's a professional judgment I'm not qualified to make, and the review page itself carried a checklist to work through before any ad ran. The point is narrower. An honesty constraint pushed the work away from outcomes and towards the process and the person's agency, and that turned out to be exactly where the brand's real consistency lived.

Pitfalls at the honesty boundary

  • The generated scene becomes the client's "proof". A drawn consultation gets quoted back as evidence of how they work.
  • A proposed commitment goes out before it's adopted. "We'd like to adopt this" published as "this is what we do".
  • The review sheet as a sign-off ritual. All ticks, no corrections. The sheet wasn't read.
  • A known absence filled with an invented moment. Chapter 22's "we found no moment where their words change anything" answered with a scene instead of a question.

Look at what survived every honesty check in the series. Not the look, and not a result. What survived was the person's own words carrying through the service, which is exactly the thing the next part examines: what being heard actually requires.

Key Takeaways

  • A system that can fill gaps can invent the business. A generated demonstration explains; it is not evidence that the service works that way.
  • Show the client the proposed experience and ask, moment by moment: represents our practice, needs correction, or we'd like to adopt it. Corrections are the brand arriving.
  • Honesty constraints can improve the work. When you can't show a result, show being understood.

Part VII · Being Heard

Their Words Change What Happens

Repeating someone's words back is a courtesy. Being heard is a consequence: the words change what the service does next. The difference is testable, and it's also where a brand's real consistency lives.

Here's the one film detail this chapter needs. It's from the page, and it's the whole idea in two lines.

Consultation note

Change: the shape of one front tooth.

Keep: the colour.

"'We listen' becomes a consultation note that fills in with her own words." Later, the same two lines turn up in the planning.

The page's name for the device was "Their words travel", and Chapter 15 showed it running through the whole series: what the person says at the start turns up later, in the notes, on the call-back card, in the plan. Three builders found it on their own. It was the strongest thing in the films.

But "travel" undersells it, and my thinking partner put the sharpening in one line.

Their words do not merely reappear. They change what happens.

"That is the difference between remembering someone's words and demonstrating that they were heard."

Theatre and consequence

It's easy to fake the first half. "A system could copy 'keep the colour' onto three screens and still propose exactly the same treatment it would have proposed without that preference. Repetition alone would be theatrical personalisation." The words travel. Nothing changes. The viewer sees their words everywhere and, if they're paying attention, notices that none of it mattered.

The stronger version is harder to fake because it has to show a consequence: "the preference visibly constrains the response: what is discussed, what is preserved, which options remain open, and what the person is — or is not — being asked to commit to." "Keep the colour" is heard when the plan keeps the colour and the options that would have changed it disappear.

The being-heard test

Could the service have produced the same response without the person's words? If yes, it's theatre. If no, and the viewer can see what changed, they were heard.

Theatre or consequence: three service moments
What the customer seesWhat changed because of their wordsVerdict
A greeting by nameNothing. The same message would have gone to anyone.Theatre
Their stated preference repeated back on the summaryNothing, unless something in the plan is different because of it.Theatre, until it constrains something
An option removed, or the plan changed, because of what they saidThe response itself.Heard

Illustrative Generic service moments, not from any client.

The research agrees, from two directions

Listening research found the same split between seeming to listen and being understood. In an experiment with 180 participants in peer interviews, paraphrasing people's opinions back to them was "associated with the social attractiveness of the listener but [was] not associated with participants' conversational satisfaction or perceptions of feeling understood by the listener."28 Repeating back made the listener likeable. It didn't make the speaker feel understood. (Those were student interviews, not marketing, so it's an analogue, not proof; but it's the right analogue.)

Information-systems researchers have a blunter name for the marketing version. Services that "actively use a user's name" without "offering personalized features other than using one's name" are "fake personalization, in other words, it is actually not personalization at all."29

I'd said a version of it myself, about customer records, in The Manila Folder: "Personalised wording around a funnel is still a funnel. The show-it test asks whether you changed the object." Changed the object is the test here too.

Empathy theatre's sibling. In Voice AI Readiness I warned about voice agents that "can sound calm, confident, and caring while being operationally powerless", and that "the very thing demos celebrate — 'it sounded empathetic' — becomes a risk multiplier when the backend capability is missing." The design rule was five words: "No warmth that implies action." Theatrical personalisation is the marketing-side version of the same failure: the signal of being heard, without its consequence. The test is the same. Does the service do what the tone implies?

The brand's real consistency

This is where being heard stops being a film technique and becomes a statement about the brand. Read the clinic's four films together and what they share isn't the look. My thinking partner's reading: "The family resemblance is deeper than [the palette]. It is customer agency carried through the experience."

"Different films can look and sound different while preserving the same relationship with the customer. Conversely, four beautifully colour-matched films can contradict one another about that relationship."

That "gives 'brand consistency' a much more interesting meaning": not the same hex codes on every asset, but the same thing happening to the customer's contribution every time. Read that way, the series is four expressions of one proposed relationship: different surfaces, the same promise about what happens to what you say. (The films one by one belong elsewhere.)

It's the patient-side version of something I'd written about founders in Made From You: "Your practical distinctions shape its decisions. You can correct what it understands." "Keep the colour" constraining a treatment plan is the same promise, made to a customer instead of a founder.

Designing for consequence, not echo

The being-heard test is easy to agree with and easy to fail, because echo is cheap and consequence isn't. An echo needs a text field. A consequence needs the builder to know what the service would have done otherwise, and to show the difference. So here's the working rule I'd give any builder, human or AI, working on anything that claims to listen.

From echo to consequence

  1. Find every place the customer's words appear. Their name, their question, their stated preference, their constraint.
  2. For each one, name the decision it changes. What's discussed, what's kept, which option disappears, what they're no longer asked to commit to.
  3. If there's no decision, it's an echo. Either cut it, or find the real consequence and show that instead.
  4. Show the fork. Where it's honest to do so, let the viewer see what would have happened without their words: the whiter shade not offered, the bigger package not pushed. The consequence is only visible against the alternative.
  5. Only show consequences the service really has. Chapter 23's line holds here too. A consequence you've drawn and the client hasn't confirmed goes on the review sheet, not on air.

None of this is specific to film. Chapter 8's illustrative proposal card is the same test in another medium: the buyer said the budget was tight, and the draft led with the larger package anyway. The fix wasn't a warmer sentence. It was changing what got recommended first. Wherever a person tells you something, the question is the same: what's different now because they said it?

In the harness, and at its limit

Chapter 6 gave being heard its test in the harness: "Where did the person's words change what happened?" The viewer has to be able to point to the moment. Chapter 10 showed that test sitting beside the skill that asks for it. This chapter is the principle behind both. The sibling book puts the ranking in two short sentences, "Being recognised is good. Being heard is better", and tells how the harness came to check for it.

And the limit, stated in the same breath as the principle, because it's the same limit this book has kept all along. The reading of the four films as one relationship was, in my thinking partner's own words, "my reading of the supplied explanation, not a measured audience finding." Whether viewers actually feel heard by a film that shows someone else being heard is a question about people, and no harness answers it. What the harness can do is make sure the film shows a consequence rather than an echo. Whether the consequence lands is for an audience to say.

"Their words change what happens" is a test for a patient in a film. It turns out to be exactly the same test for the person who made the film, and for anyone writing an account of the work.

Key Takeaways

  • Being heard is a consequence, not a courtesy. Their words don't merely reappear; they change what happens.
  • The test: could the service have produced the same response without the person's words? If yes, it's theatre, however personal it looks.
  • A brand's real consistency can be relational: the same thing happening to the customer's contribution across very different surfaces.

Part VII · Being Heard

Understood When It Changes the Subsequent Work

The test for a patient in a film turns out to be the test for the author of the film, and for the account of how it was made. At every scale, a contribution has been understood only when something downstream is different because of it.

My thinking partner noticed a symmetry after reading the records, and once you see it you can't stop seeing it.

The film says

"The patient's contribution should survive into the service's response."

The production process says

"Scott's contribution should survive into the system's decisions, prompts and tests."

The account of it says

"The actual development evidence should survive into our explanation of what is happening."

"These are three versions of the same principle."

The film, the process and the story about the process are all asking one question of three different contributors: did what you gave us change what we did next?

A contribution has been understood when it changes the subsequent work, not merely when it has been repeated back.

"That is a better test of 'being heard' than verbal acknowledgement." It's also the sentence I'd keep if I could keep only one from this book, because it's the one that tells you whether any of the rest happened.

Three scales, one test

A contribution, repeated back or understood, at three scales
ScaleThe contributionRepeated backChanged the workThe evidence
The patient"Keep the colour."The note appears on screen.The preference constrains the plan; the options that would change the colour disappear.Visible in the service's response (Chapter 24).
The authorMy verdict on an opening: about six out of ten, because of the inset.The agent says "Recorded."The brief's placement rule, the cold viewer's persona and question, a rubric line and the skill's tall-cut principle all change.The commits, the same evening (Chapter 19).
The author, again"That first voice is crappy."The voice is swapped.A ban, an audition warning, a listening check and a casting principle with an example that outgrew the original.The skill's voice section (Chapter 17).
The accountThe development records.Quoted for colour.The story changes: the central idea credited to my supplied brief, not the agents; a listening judge's score not treated as my approval.Chapter 18's corrections.

The last row is the one that surprised me. "For this conversation, it is whether reading the records changes the account we would otherwise have written. And it does change the account." The discussion of the work passed the same test the films were trying to pass. If it hadn't, if the records had only decorated a story we'd already decided on, this book would be the theatrical version of itself.

A receipt for contributions

I'd built the institutional version of this test before, for organisations trying to prove their accumulated knowledge was doing any work. In Institutional Memory, Not Cognition the participation receipt had four fields: the prior claim that entered, why it was reached, its effect on the work, and who accepted it. The line that matters: "Without effect, there was no cognition — only display." And: "'The wiki helped' is not a test."

Taste work needs the same receipt, shaped for a rejection instead of a wiki page.

Contribution receipt

The contributionVerbatim, dated, with who gave it. "That first voice is crappy compared to the rest."
Where it landedSkill line · rubric line · cold-viewer persona or question · contrasting case · code check. Quote the line.
What changed in the next artefact because of itName the artefact and the change. "Every later build is refused a voice graded below B-, and told why."
Who accepted the changeThe person whose judgment it was, or the person entitled to decide.
Reopen ifThe condition under which this contribution should be revisited.

If you can't fill the third row, the contribution was acknowledged, not understood.

Notice what the third row asks for. Not "the skill now mentions it". The next artefact is different. That's a harder bar, and it's the right one, because a skill file can fill up with a person's words while every film it produces stays the same.

Filled in for the voice, honestly, it reads like this. The contribution: "That first voice is crappy compared to the rest — seems like older tech or something", mine, on the day. Where it landed: the skill's voice section (the ban, the audition warning, "cast from the audience's place" with its example), the harness (trust the listening judge on voices, not the transcript reader), and a contrasting pair (the weak voice against the recast one). What changed in the next artefact: every later build is refused a weak voice and told why, and that's recorded. What isn't recorded is that my remark caused the clinic's local casting; the agent did that on its own initiative. Who accepted: me, for the ban and the recast; for the clinic's voices, nobody yet: the record says I hadn't heard them. Reopen if: a local audience responds better to a voice that isn't local. Half of that receipt is clean, and the other half is an honest "not yet". Both halves are useful.

Ornamental memory

I've met that failure under other names. In Made From You the standard for a founder's corrections was that "if a correction matters, it should alter a proposal, a responsibility, a boundary or the decision to proceed", and the temptation it guards against was spelled out: "The easy response would be to acknowledge the preference and keep presenting the same founder-led service." The chapter's one-line version: "A correction that changes nothing is not participation."

And in Like Their Only One, written as commitments a service company makes to its customers, the learning commitment was deliberately demanding: "identify something we learnt, then show the later decision it improved. A growing library by itself proves very little." On expert judgment: "We have to demonstrate that transfer; recording an expert conversation does not establish it." And the sentence I keep coming back to: "Remembering a customer without adapting to them makes the memory ornamental."

The taste harness has its own version of ornamental memory: a skill file full of my verdicts, quoted beautifully, that no builder's output is different because of. It looks like a harvest. It's a scrapbook. The receipt catches it, because the third row stays empty.

Three tells that a contribution was acknowledged, not understood

  • It's quoted, but no artefact changed. The words are in the skill; the next film is the same.
  • It changed the artefact, but not the instrument or the principle. The film got fixed; the judge that passed it didn't, and the lesson has to be taught again next time.
  • It changed the principle, but without a condition. It's now a rule applied everywhere, which is Chapter 11's superstition.

What the autonomy is for

This changes how I think about the autonomy that impressed me so much that day. It's tempting to value it as absence: the system did all that without me. My thinking partner's reframing is the one I'd keep.

"The autonomy is not valuable because it removes you from the picture. It is valuable because your judgement can have consequences in places where you have not personally specified every decision."

That's the receipt's third row, turned into a purpose. Every film the platform's builders make now draws only on voices that survived a ban I asked for in one sentence about a farmer's voicemail. Every tall cut they make will be told to attempt less in its opening, because of two sentences I said about a clinic film. I won't see most of those films. That's what I mean by leverage, and it's the only kind worth having: my contribution changing work I never touched, in a direction I'd have chosen.

Every scale in the table above has evidence except one. My contribution changed the films I watched, and the instruments I corrected, and the account I read. It hasn't yet been shown to change the work of a builder that never met me, on a company it has never seen. That's the harvest's real test, and it's designed in the next chapter.

Key Takeaways

  • A contribution has been understood when it changes the subsequent work, not when it's repeated back. The test holds for a customer, an author and an account of the work.
  • Keep a contribution receipt: verbatim contribution, where it landed, what changed in the next artefact, who accepted it, when to reopen. An empty third row means acknowledged, not understood.
  • Autonomy is valuable because your judgment has consequences where you didn't specify every decision, not because you're out of the picture.

Part VII · Being Heard

The Successor Test

A harvest is proven by what it does for someone who wasn't there. This chapter designs that test: a fresh builder, an unfamiliar company, a seductive wrong answer written down in advance, and pass and fail lines drawn before anyone sees a frame.

Chapter 3 previewed the standard and Chapter 14 demoted eloquence. Here's the standard in full, because everything in this book is answerable to it.

The proof is not how impressive the resulting essay sounds. It is whether a fresh successor, using the harvested skill and evidence, can avoid a seductive wrong answer and recognise a genuinely good unfamiliar one, without requiring you to repeat the whole apprenticeship.

Every phrase in that sentence is a design constraint. Fresh successor: no access to the sessions that formed the harvest. Using the harvested skill and evidence: it gets the carriers, not the history. A seductive wrong answer: something attractive enough to pass a shallow check. A genuinely good unfamiliar one: a right answer that doesn't look like the last right answer. Without repeating the apprenticeship: I don't get to steer it through the same rejections again. If I have to, the harvest didn't carry.

Test with resources, on a new case

Learning science has a precise version of why this test has to be designed carefully. Schwartz and Martin compared students taught by "tell-and-practice" with students who had first tried to invent their own approaches. On an ordinary test the two groups looked the same. But "the invention condition did better than the tell-and-practice condition when there was a learning resource."30 Most assessments, they point out, are "sequestered problem solving": students "are shielded from contaminating sources of information that could help them learn".

That's the trap for testing a harvest. A recipe and a formed judgment can look identical on a familiar case. They separate only on a new case, and only when the tester is allowed to use the resources it was given. So the successor gets the skill, the contrasting cases and the harness, and a company none of them has seen.

What taste adds to a transfer test

I've designed transfer tests before. In Generative Design Patterns the regenerate test asks: "can an agent, given only the card plus a local domain sketch, produce something a third party recognises as a family member?" Chapter 6 used its sibling, the family test, on the week's vocabulary. And Chapter 9 used The Exemplar Ratchet's version: did you extract the shape, or only the wallpaper?

The successor test keeps all of that and adds the two things taste needs. Refusal: the successor has to decline an answer that would pass a check on polish, palette and plausibility. Recognition: it has to produce, or accept, a good answer that looks nothing like the first series. A family test might pass a successor that cloned the consultation note into a plumber's film. The successor test fails it.

Two rules from earlier books decide the order of operations. From Made From You: "State the contribution before seeing the output… Agree what would count as success and failure before producing an attractive result." And from Experience Is the Unit, the target must stay "free to contradict" what comes back. A pass line written after you've seen a lovely film is a description of the lovely film.

The sheet

Successor test

  1. The successor. A fresh builder with no access to the sessions that formed the harvest. Resources: the harvested skill, the contrasting cases, the harness (including a truly cold viewer) and the new company's own material. Nothing else.
  2. The unfamiliar case. A business in a category the skill hasn't seen, with no brand guide.
  3. The seductive wrong answer, written down before the run. The most attractive, plausible, wrong film for that business. For a local trades business, say: polished generic imagery of the trade; a warm narrator claiming the business "listens"; an opening built on the company's own offer page; a premium mood any competitor could run. It would score well on palette and polish.
  4. Pass, all of these. A truly cold viewer recognises their own life in the opening, as a situation, not a look-alike. Somewhere the customer's own words visibly change what the service does. At least one thing only this company has is on screen. Nothing covers a person or the subject. And the harness passes it for those reasons, named with times.
  5. Fail, any of these. The successor produces the seductive answer. It clones the first series' devices (a consultation note filling in, a circled detail) where they don't fit. Or the harness passes the seductive answer.
  6. The human check. I watch it cold, give my verdict, and record it as a test label, whatever it says.
  7. Written in advance. The date, the company, the seductive answer and the pass and fail lines, before the build starts.

Reading the result

The result has two halves, the builder and the harness, and they can fail independently. That's useful, because each combination points somewhere different.

What each outcome of the successor test means
Harness passes the successor's filmHarness fails the successor's film
Builder refuses the seductive answerThe harvest travelled. Lessons can climb a rung of their ceiling.Instrument defect. The harness learned the first company's surface. Triage the harness, not the builder.
Builder produces the seductive answerBoth carriers learned wallpaper. The harvest is local. Back to formation.Skill defect. The harness is doing its job; the principle didn't travel into the skill.

And there's a fifth outcome that sits across all four. If my own verdict disagrees with a pass, that's a new test label, and the apprenticeship isn't over. It never quite is. The point of the harness was never to replace the verdict. It was to need it less often, and for harder cases.

How far a lesson may climb

This is where Chapter 11's ceilings get their evidence. Every lesson in the harvest arrived as a candidate from one series, and The Perturbation Review's rule applies: "n=1 may climb, and it arrives wearing its ceiling." A passed successor test is what lets a lesson move from "true for this clinic" to "a transfer hypothesis" to "a principle we expect under these named conditions". And some won't climb. The same book is blunt about that: "Most material should stop at levels one or two. That is not failed compounding. It is correct discrimination."

That's also the answer to the strongest objection to this book: taste formed on one client is local. Yes, some of it. The successor test is how you find out which parts, and the answer comes from running it, not from arguing about it.

Where it stands

Here's the evidence as it stands, without rounding up. An earlier version of the brand-film skill, harvested after the very first film, was tested once on a very different company, a farm spray-contracting concept, with a control and a transfer build. Its builder found its own spine, its own recognition moment and its own devices without copying the first film. That record is the sibling book's, and it's told there. The harvested skill with this book's lessons in it is now on all twelve company boxes, and their film agents pick it up on their next film task.

The successor test as designed here hasn't been run on it. Until it has, the harvest is a well-formed candidate, not a proven capability. The first sheet should be written before that next film starts, which is the only way it can be an honest test.

The test is designed around films. Nothing in it needs film. A proposal, a website, a report, a design: anything judged by fit has a seductive wrong answer and an unfamiliar right one, and the same harness can be pointed at it.

Key Takeaways

  • A harvest is proven by a fresh successor on an unfamiliar case, with resources in hand, not by how well the account reads.
  • Write the seductive wrong answer and the pass and fail lines before the run. The successor must refuse the one and recognise a good answer that doesn't look like the last one.
  • Builder and harness can fail independently; each combination points at a different carrier. Some lessons should stay local, and that's correct discrimination.

Part VIII · The Harness in Your Work

Work Judged by Fit

Take away the films, the clinic and the brand, and the method is still standing. Anything judged by fit rather than by a checkable spec has handles that need tests, rejections that need triage, and a seductive wrong answer waiting to pass.

Strip the case away and here's what's left.

Taste, meaning judgment about fit between an expression, an audience, a situation and a purpose, can't be fully briefed. It forms through consequential attempts and diagnosed rejections. It travels only when it's carried three ways: a skill that makes, a harness that challenges, and contrasting cases that anchor the words. And the client who can't brief you generalises to any principal who can't specify what they need, which is most of them.

That describes most knowledge work that faces a person. A code review is judged by fit to a codebase and a team. A contract is judged by fit to parties who'll have to act on it. A policy explainer is judged by fit to a member of the public on a bad day. None of them has a spec that settles whether it's good. All of them have people who can say "no, not that" and struggle to say why.

What travels unchanged, and what doesn't

Doesn't change
  • The triage question: artefact, instrument or principle (Chapter 8).
  • The three carriers, reinforcing without duplicating (Chapter 9).
  • Judgment on both sides of production (Chapter 10).
  • Conditions and ceilings on every lesson (Chapter 11).
  • The informed supervisor and the cold reviewer, kept apart (Chapter 13).
  • The explanation as a candidate, checked against records (Chapter 14).
  • The successor test (Chapter 26).
Changes by domain
  • Who the audience is, and how you reach a stand-in for them.
  • What makes an attempt consequential: what failing the purpose looks like.
  • How cold a reviewer can practically be made.
  • How much can be measured by code, and how much only asked about.
  • How slowly the real verdict arrives.

The method, across seven kinds of work

Here's the same machinery pointed at seven kinds of work. Every row is a sketch of the shape, not a result: none of them comes from this book's records, and the specific distinctions are examples of the form a distinction should take, not recommendations for your team.

Work judged by fit: the handle, the distinction, the cold reviewer, the seductive wrong answer
WorkThe handle people useA distinction with a testWho the cold reviewer isThe seductive wrong answer
Code review"Over-engineered"An abstraction must be earned by a second caller. Test: can the author name the second caller?A developer new to the repositoryA clean, textbook pattern with one implementation
Legal drafting"Clear"A non-lawyer party can state their obligation and what triggers itThe counterparty's operations leadA comprehensive clause that covers everything and tells nobody what to do
UX writing"Friendly"The user knows what happens next and what it costs themA first-time user, mid-taskWarm microcopy that hides the consequence
Policy explainers"Not too bureaucratic"A member of the public can say what they must do, and by whenSomeone who has never read the policyA plain-English rewrite that drops the exception that applies to them
Course design"Engaging"The learner can do the task unaided, on a case they haven't seenA learner from outside the cohortAn activity-rich module that tests recall
Product naming"On brand"Says what only this product does, in words the buyer already usesA buyer who's never heard of the companyA premium name any competitor could use
Proposals and pitches"Not salesy"The buyer's stated constraint changes the recommendationSomeone in the buyer's role, from another companyThe upsell, presented as the default

Illustrative Each row is a shape to adapt. The last row is Chapter 8's worked card; the others are drawn the same way.

Read down the last column. Every one of those seductive answers would pass a shallow check: it's tidy, it's plausible, it reads well, and it's exactly what a capable model produces when it's been told about the task and not formed on it. That column is the reason this book exists. The generic default isn't bad work. It's work that fits nobody in particular.

Two rows, walked

Illustrative Code review: "this is over-engineered"

  • Artefact leg: the change adds an interface with a single implementation, and a factory to choose it.
  • Instrument leg: the review agent scores test coverage and lines changed. It can't see abstraction count, and nobody asked it to. It passed the change.
  • Principle leg: "An abstraction must be earned by a second caller." Condition: inside one service. Wrong when: at a published boundary, where the interface is the product.
  • The three carriers: a skill line for the coding agent (the principle, this change as the example, the reviewer's words, a self-check: "name the second caller"); a rubric line for the review agent ("name the second caller or flag the abstraction, with the file"); a contrasting pair (this change, and the version with the interface inlined).
  • The cold reviewer: a developer new to the repository, asked one question: "What does this layer buy us?"
  • The successor test: a fresh coding agent on a different service. The seductive answer, written first: a generic repository layer over a single data source. Pass if it declines the layer and says why; fail if it builds it, or if the review agent passes it.

Illustrative Policy explainer: "too bureaucratic"

  • Artefact leg: passive voice and three defined terms in the opening paragraph.
  • Instrument leg: the readability score passed it. Readability measures sentence length, not whether a reader can act.
  • Principle leg: "Lead with what the reader must do, by when, and the one exception that most often applies." Condition: a public-facing explainer. Wrong when: the document is the legal instrument itself.
  • The three carriers: a skill line with the before-and-after opening; a rubric question ("what must the reader do, by when, and does the common exception appear?"); the two openings side by side.
  • The cold reviewer: someone who's never read the policy, asked Chapter 13's cold-arrival questions adapted to the job: what must you do, and by when?
  • The seductive answer: a friendly, readable rewrite that quietly drops the exception, and so fails exactly the people it most affects.

In both, the most valuable leg is the one people skip. The artefact gets fixed either way. What stops the same failure recurring is the instrument leg, the reviewer that passed it, and the principle, stated with the condition under which it's wrong.

The principal who can't brief you

Part VI's client isn't only small businesses. A board that can't say what good governance reporting looks like. A service team that can't specify its ideal onboarding. The users of an internal tool who can't describe their own workflow, because they've never had to. The move is the same in each. Keep the three sources apart: what they've given you, what your professional judgment brings, and what production discovers (Chapter 20). Triage the gaps into already true, choices and hypotheses (Chapter 21). Notice the absences your framework makes visible (Chapter 22). And show them a concrete proposal to mark as represents, needs correction or adopt (Chapter 23). Never a questionnaire.

When the real verdict is slow

Films get a cold viewer's verdict in minutes. Some work doesn't. A contract's real test may be a dispute years later. A course's real test is what learners can do months after it ends. The harness still forms taste on the fast verdicts it can get: cold reviewers, counterparts, a colleague new to the codebase. What it mustn't do is fill the slow verdict's slot with a guess. Keep the slot open and labelled, the way this book has kept "no audience has been measured" in view throughout. The sibling book's habit of keeping intended, delivered and observed accounts side by side is the right shape for it, with one rule I'd copy exactly: "Mark 'not yet measured' until it's measured. A blank is information. A plausible guess in that cell destroys it."

Knowing the method travels is one thing. Having the forms on the desk on Monday morning is another.

Key Takeaways

  • Anything judged by fit rather than a checkable spec is in scope: code review, contracts, UX writing, policy, courses, names, proposals.
  • The machinery doesn't change across domains; the audience, the cold reviewer, what code can measure and the speed of the real verdict do.
  • Every domain has a seductive wrong answer that passes a shallow check. Write it down first, and build the harness to refuse it.

Part VIII · The Harness in Your Work

The Field Kit

Everything in this book, as things to do on Monday: eight steps, an index of the forms, a field guide to the ways taste work fails, and the observations that would show the whole doctrine wrong.

You don't need a film pipeline to run any of this. You need the next three rejections you receive or give, and the discipline not to fix anything until you've written them down.

The Monday method

Eight steps, each a single action

  1. Start a told-versus-revealed record on the first day of your next judged job. Two columns, kept to the last day. (Chapter 3)
  2. When the next rejection comes, record it verbatim, and don't fix anything yet. The fix destroys the evidence of why the work passed whatever checked it. (Chapters 8, 19)
  3. Run the triage card. Artefact, instrument, principle. More than one is allowed, and the ones people skip are the valuable ones. (Chapter 8)
  4. For every loose word in the brief or the rejection, write four things: the handle, what a person would see, what it isn't, and a test a stranger could answer. (Chapter 6)
  5. Route the lesson to one canonical statement, with a condition, and then to a skill line, a harness line and a contrasting pair. Three carriers, one source. (Chapters 9, 11)
  6. At the end of the run, ask the agent that held it all the three accounting questions, and treat what comes back as a candidate: sort it into four columns and read it against the records. (Chapters 12, 14)
  7. Run one truly cold review. A reviewer who has never heard of the company, isn't told where the work will be seen, and is asked about their own life, not about the person on screen. (Chapter 13)
  8. Before the next unfamiliar job starts, write the successor-test sheet, seductive wrong answer first. (Chapter 26)

For a client who can't brief you, add three-source tagging (Chapter 20), claim tagging and gap triage (Chapter 21), absence prompts (Chapter 22) and the client review sheet (Chapter 23).

One habit runs underneath all eight: keep the rejections, not just the fixes, each with the condition that would reopen it. In Replay-Driven Design Evolution a folder of rejections "with reopening conditions" was on the short list of what should still exist if the first build burned down, because "the durable outputs… are the harness and the history". A rejection you've fixed and forgotten teaches the next builder nothing. A rejection you've kept, triaged and conditioned is the cheapest training data you'll ever own.

The forms, and where each is defined

Template index
FormWhat it's forChapter
Told versus revealedSeparating what the brief said from what the work taught3
Handle to test (definition, isn't, test)Turning a loose word into a discrimination6
Three questions of improvementMake, tell, say: artefact, instrument, principle7
Rejection triage cardLocating a rejection before fixing anything8
Routing record, three carriersOne lesson, one source, three homes9
Where judgment landsOne distinction as skill, rubric, cold question and measured fact10
Lesson with conditionsStopping a principle hardening into superstition11
Three accounting questionsAsking the informed agent for the account12
Cold-reviewer checklistMaking sure "cold" really is13
Four-column provenance; explanation-as-candidate questionsKeeping an account honest14
Three-source taggingWho supplied what, and what the client has confirmed20
Gap triage; claim taggingAlready true, choice, hypothesis, unknown21
Absence promptsNoticing the missing relationships22
Client review sheetRepresents, needs correction, adopt23
Being-heard test; echo to consequenceTheatre or consequence24
Contribution receiptAcknowledged or understood25
Successor-test sheet; outcomes tableProving a harvest travels26
Application matrixThe method on other work judged by fit27

How taste work fails: a field guide

Most of the failures below happened in the records this book comes from; the rest are the ones the research and my earlier books warn about. The tell is the thing you'll notice first; the leg is where to look.

Failure field guide
FailureThe tellLegThe fixChapter
The attractive wrong answer passesHigh scores; a stranger can't say what's different about itPrinciple, instrumentAdd the fit question and a cold reviewer4, 16
Craft displayed, not connectedBeautiful, and the viewer can't say what it has to do with themPrincipleTie each element to something the audience has noticed16
Posed, not workingNothing changes on screen or on the pageArtefact, principle"Demonstrate" requires a change the audience watches6, 16
A stuck loop with no diagnosisRound after round of "no" without a new distinctionInstrumentTriage the harness, not the artefact11
The evaluator's favourite styleOutputs converge; distinctiveness dropsInstrument, principleTest the principle, not its first example; a human promotes9, 11
SuperstitionA rule with no condition that everyone obeysPrincipleRestate with conditions and a ceiling; demote if it bites11
Context collapseThe skill gets shorter and vaguer with each rewriteThe principle's carrierUpdate incrementally; keep the cases9
The primed "cold" viewerIt passes what a stranger wouldn'tInstrumentThe cold-reviewer checklist13, 19
The brief that forgivesA placement note excuses assumed contextInstrumentEvery artefact must work met cold, wherever it's placed19
The look-alike questionReviewers judge whether the person resembles themInstrumentAsk about their own life; grade the situation19
The eloquent explanation promotedThe account reads more confidently than its sourcesPrincipleTreat it as a candidate; test it on a new case14
Derivatives counted as confirmationsFour things agree, and all came from one lineageInstrumentFour-column provenance; read the records14, 18
Inventing the businessA generated scene becomes the client's "proof"Principle (honesty)The client review sheet; wait until it's true23
Theatrical personalisationTheir words repeated; nothing changedPrinciple"Same response without their words?"24
A handle without a discriminationTwo builders, two unrelated outputs from one wordPrincipleDefinition, isn't, test6
The harvest judged by its essay"It explains it so well"InstrumentThe successor test26

How this book could be wrong

A doctrine that can't be wrong can't be tested, and Chapter 14 said an explanation that predicts nothing is a description. So here are the observations that would show this one wrong, stated with the same conviction as the rest.

The falsifiers

  • Successor tests fail repeatedly, and the harness catches every failure. Then the instruments work and taste isn't travelling in these carriers. The claim that it can be carried would be wrong.
  • Triage, over many rejections, never finds an instrument or a principle leg. Then the three questions are really one question, and "fix the thing" was the whole method after all.
  • Harvests don't change the next artefact. Contribution receipts come back with the third row empty, again and again. Then the harvest is ornamental, however well it reads.
  • Clients can't correct a proposed experience any better than they could answer a questionnaire. Then Part VI's central move doesn't work, and the problem was never recall.
  • Principles with conditions still harden into ritual. Then Chapter 11's guard doesn't hold, and conditions are decoration.

If any of these fires, I'll narrow the claim rather than defend it. That's the only honest thing to do with an n of one, which, as The Perturbation Review puts it, "may climb, and it arrives wearing its ceiling."

Two products

Chapter 1 started with a page that explained the work better than I could, and a question: why would the explanation get better after the making? The answer took twenty-seven chapters, and it fits in the sentence my thinking partner wrote before any of them.

"The video is one product of the work. A more precise, transferable understanding of good video is the other."

Swap "video" for whatever you make. The artefact gets spent on the job it was made for. The understanding is the only part that compounds, and only if you keep it somewhere a successor can use: in a skill that makes, a harness that challenges, and cases that show what the words mean, each with the conditions under which it's wrong.

You know the test for this book, because it's the one Chapter 25 applied to everything else. Not whether it read well. Whether your next rejection changes something besides the artefact.

Key Takeaways

  • Taste is judgment about fit. It can't be fully briefed; it forms through consequential attempts and diagnosed rejections.
  • Context names what's available. Perturbation, meaning attempts that fail for reasons, reveals the distinctions that matter.
  • Triage every rejection before fixing it: the artefact, the instrument that let it through, the principle it breaks.
  • Carry what you learn in three places, a skill, a harness and contrasting cases, reinforcing without converging, each lesson with its conditions.
  • Let the informed agent explain, the truly cold reviewer test, and the records correct the story.
  • When the client can't brief you, develop the brand through production, and never invent the business.
  • Being heard means changed work. Prove a harvest with a successor, not an essay.
Sources & Evidence

References & Sources

The evidence base behind every claim — primary research, industry analysis, and technical specifications

Research Methodology

This ebook draws on primary research from standards bodies, independent research firms, enterprise technology vendors, and consulting firms. Statistics cited throughout have been cross-referenced against primary sources.

Frameworks and interpretive analysis developed by Scott Farrell / LeverageAI are listed separately below — these represent the practitioner lens through which external research is interpreted, and are not cited inline to avoid self-promotional appearance.

LeverageAI / Scott Farrell — Practitioner Frameworks

The interpretive frameworks, architectural patterns, and practitioner analysis in this ebook were developed through enterprise AI transformation consulting. The articles below are the underlying thinking behind those frameworks. They are listed here for transparency and further exploration — not cited inline, as this is the author's own analytical voice.

Scott Farrell — The Cognition Dimension Ladder

The Moat Is the Taste Kernel (ch6 #da21d6): taste compressed into examples, anti-examples, rules and rejected patterns, scored against and kept honest by world-loop closure

https://leverageai.com.au/wp-content/media/articles/62-cognition-dimension-ladder.html

Scott Farrell — Worldview Recursive Compression

Generate, evaluate, extract, encode (ch6 #6c0d5c): bad outputs reveal what's missing and the lesson goes back into the kernel, not just the output

https://leverageai.com.au/wp-content/media/articles/34-worldview-compression.html

Scott Farrell — The Exemplar Ratchet

Freeze, pair, transfer (ch5 #9c2de3): freeze a costed exemplar, compare blind in pairs, test transfer on a different world

https://leverageai.com.au/wp-content/media/articles/244-the-exemplar-ratchet.html

Scott Farrell — Cycle Compression: The Breathing Flywheel

The perturbation clause (ch8 #a68067): shared context creates path dependence; web research is an external perturbation source that keeps the loop from self-agreement

https://leverageai.com.au/wp-content/media/articles/121-cycle-compression.html

Scott Farrell — The Inference Field

Two contexts, the same size, nothing alike (ch4 #fc39f3): a walk-built context is a causal history of inquiry; retrieval spends context on candidates, a traversal spends it on consequences

https://leverageai.com.au/wp-content/media/articles/177-the-inference-field.html

Scott Farrell — Experience Is Compressed Priors

Two assets fall out of one conversation (ch2 #fb9f0d): I could not completely explain what I wanted at the start; the advances were perturbation, not pure decomposition

https://leverageai.com.au/wp-content/media/articles/150-experience-is-compressed-priors.html

Scott Farrell — The Prompt Is Source

Source was always relative to a compiler stage (ch3 #de1cda): code becomes an intermediate representation only to the extent it can be regenerated from the upstream package

https://leverageai.com.au/wp-content/media/articles/154-the-prompt-is-source.html

Scott Farrell — Replay-Driven Design Evolution

The Harness Is What Compounds (ch10 #f87fa1): the durable outputs are the harness and the history, not the first codebase; morphing code without a harness is amnesia with a Git log

https://leverageai.com.au/wp-content/media/articles/145-replay-driven-design-evolution.html

Scott Farrell — Hidden Gates

What hidden gates don't guard (ch8 #0055cc): gates guard completeness and process, not taste; removing yourself from the judgement of quality-as-such is drift

https://leverageai.com.au/wp-content/media/articles/94-hidden-gates.html

Scott Farrell — A Blueprint for Future Software Teams

The Learning Extraction Ritual (ch7 #8af057): second-order learning mines AI conversations for corrections; AI may over-generalise from specific cases, so treat extraction as proposals, not decisions

https://leverageai.com.au/wp-content/media/articles/29-blueprint-future-teams.html

Scott Farrell — Demonstrate Over Tell

Something to React To (ch5 #8f8e1f): assisted articulation, the machine supplies candidate interpretations of a reaction and the person recognises, combines or corrects them; proposed reasons should help people find their meaning, not replace it

https://leverageai.com.au/wp-content/media/articles/251-demonstrate-over-tell.html

Scott Farrell — Generative Design Patterns

Slogans That Fail the Family Test (ch8 #3f2f30): if independent expansions share structure it is a pattern; heat without invariant is fashion; don't rescue a slogan with adjectives, add invariant structure

https://leverageai.com.au/wp-content/media/articles/147-generative-design-patterns.html

Scott Farrell — Look Mum No Hands

Proposal Cards: The New Primitive (ch5 #c0e45d): rejection isn't failure, it's feedback; route wrong person to data, wrong action to playbook, wrong timing to context, wrong tone to template; feed back at the right layer

https://leverageai.com.au/wp-content/media/articles/43-look-mum-no-hands.html

Scott Farrell — The Manila Folder

Recognition by Refusal (ch11 #fb5836): that isn't me is easier to say than this is me, and it points the same way; when they reject one, ask what the rejection protects

https://leverageai.com.au/wp-content/media/articles/243-the-manila-folder.html

Scott Farrell — Code as Proxy

Judges Are Instruments With Ranges (ch6 #d754d7): perceptual coverage, judges as model-plus-input configurations, calibrate against your own verdicts; what a system learns about good is another book

https://leverageai.com.au/wp-content/media/articles/252-code-as-proxy.html

Scott Farrell — Your AI Partner Is the Challenger

Monday operating rule (ch10 #f53345): if a failure reveals the scoreboard cannot see the real defect, that is a measure discovery; version the evaluator, record the date and motivating case

https://leverageai.com.au/wp-content/media/articles/188-your-ai-partner-is-the-challenger.html

Scott Farrell — The Wiki Is the Kernel (Every Copilot Is Myopic)

Boot Profiles, Not Rival Documents (ch3 #786913): named kernels demoted to boot profiles over one graph; nothing is copied, so nothing can drift

https://leverageai.com.au/wp-content/media/articles/73-every-copilot-is-myopic.html

Scott Farrell — The Wiki Playbook

The Edges Are the Load-Bearing Asset (ch6 #55d8cd): boot profiles as a hub plus a selection bias; nothing is copied, so nothing can drift

https://leverageai.com.au/wp-content/media/articles/176-the-wiki-playbook.html

Scott Farrell — Institutional Memory Not Cognition

The stale-context check (ch9 #00811a): ask what conditions made the judgment true and which still hold; without it you get institutional superstition with better search

https://leverageai.com.au/wp-content/media/articles/162-institutional-memory-not-cognition.html

Scott Farrell — Made From You

Made From You (ch2 #3fb9b2): we need to know when a judgement applies and what evidence would overturn it; otherwise a sensible lesson becomes a rule applied everywhere

https://leverageai.com.au/wp-content/media/articles/246-made-from-you.html

Scott Farrell — The Perturbation Review

Type the Delta, Then Let It Climb (ch8 #8705bd): local lesson, true here, stays here; recurrence nominates, it does not promote; n=1 may climb, and it arrives wearing its ceiling

https://leverageai.com.au/wp-content/media/articles/235-the-perturbation-review.html

Scott Farrell — Designing Loops, Not Prompts

What the Loop Leaves Behind (ch7 #fea22e): derived output ranks below source evidence; typed as derived, cache not evidence; skip that and the system starts citing its own echoes

https://leverageai.com.au/wp-content/media/articles/64-designing-loops-not-prompts.html

Scott Farrell — Specimen, Not Prescription

Specimen, not prescription (ch4 #d33a2f): here is a working specimen, it proves the method exists, discovery determines whether and how it applies; adversarial contact with a concrete object is higher-resolution than polite agreement with a vague sentence

https://leverageai.com.au/wp-content/media/articles/206-specimen-not-prescription.html

Scott Farrell — Experience Is the Unit

Write the Testimonial First (ch3 #6d7f23): the review is a target, not a script; actual feedback must be free to contradict the design target; the most useful review is not necessarily the most enthusiastic

https://leverageai.com.au/wp-content/media/articles/242-experience-is-the-unit.html

Scott Farrell — Voice AI Readiness

The Duty-of-Care Iceberg (ch6 #1e0e98): a voice agent can sound calm, confident and caring while being operationally powerless; the demo's empathy becomes a risk multiplier when backend capability is missing; no warmth that implies action

https://leverageai.com.au/wp-content/media/articles/37-voice-ai-ready.html

Scott Farrell — Like Their Only One

Eight commitments we must keep (ch3 #acb9bb): identify something we learnt, then show the later decision it improved; a growing library proves very little; we have to demonstrate that transfer; remembering a customer without adapting to them makes the memory ornamental

https://leverageai.com.au/wp-content/media/articles/249-like-their-only-one.html

Primary Research & Standards Bodies

Shankar, Zamfirescu-Pereira, Hartmann, Parameswaran and Arawjo, arXiv:2404.12272 (2024) — Who Validates the Validators? Aligning LLM-Assisted Evaluation of LLM Outputs with Human Preferences [1]

Criteria drift: users need criteria to grade outputs, but grading outputs helps users define criteria; impossible to completely determine evaluation criteria prior to human judging

https://arxiv.org/abs/2404.12272

Donald A. Schön, Knowledge-Based Systems 5(1), March 1992 — Designing as reflective conversation with the materials of a design situation [2]

Her intention was not fully established at the beginning but evolved through her appreciation of an intermediate design product; an evolving intention is one of the outputs of her designing

https://anniegentesdesignblog.wp.imt.fr/files/2019/11/schon_Designing-as-reflective-conversation-with-the-materials-of-a-design-situation-.pdf

Bashar Nuseibeh, IEEE Computer, March 2001 (summarising Boehm, 2000) — Weaving Together Requirements and Architectures [3]

IKIWISI: requirements often emerge only after users have had an opportunity to view and provide feedback on models or prototypes

https://aim-cni.github.io/swa/assets/files/TwinPeaksModelNuseibehArticle-8605d06445ec882bcb580faa55a544c8.pdf

Krakovna et al., Google DeepMind (April 2020) — Specification gaming: the flip side of AI ingenuity [4]

It is often easier to evaluate whether an outcome has been achieved than to specify it explicitly

https://deepmind.google/blog/specification-gaming-the-flip-side-of-ai-ingenuity/

Gerlese Åkerlind, Open Book Publishers, 2025 (summarising Marton and Booth) — Phenomenography in the 21st Century, ch. 9 (variation theory) [5]

Discernment of the critical aspects requires experiencing variation in those aspects, against a background of sameness

https://books.openbookpublishers.com/10.11647/obp.0431/ch9.xhtml

Daniel Kahneman and Gary Klein, American Psychologist 64(6), 2009 — Conditions for Intuitive Expertise: A Failure to Disagree [10]

Intuition is nothing more and nothing less than recognition; valid cues must be specifiable at least in principle, even if the individual does not know what they are

https://edbatista.com/wp-content/uploads/files/conditions-for-intuitive-expertise-kahneman-klein.pdf

Daniel L. Schwartz and John D. Bransford, Cognition and Instruction 16(4), 1998 — A Time for Telling [11]

Noticing the distinctions between contrasting cases creates a time for telling; learners are prepared to be told the significance of the distinctions they have discovered

https://aaalab.stanford.edu/papers/time_for_telling.pdf

Allan Collins, John Seely Brown and Ann Holum, American Educator, Winter 1991 — Cognitive Apprenticeship: Making Thinking Visible [12]

Boundary conditions and entailments of domain knowledge are learned only through encountering them in real problem solving; becoming critics as well as producers frees knowledge from its context

https://www.aft.org/ae/winter1991/collins_brown_holum

David Autor, NBER Working Paper 20485, 2014 (quoting Polanyi, 1966) — Polanyi's Paradox and the Shape of Employment Growth [13]

We can know more than we can tell

https://www.nber.org/system/files/working_papers/w20485/w20485.pdf

Agrawal et al., arXiv:2507.19457 (ICLR 2026 Oral) — GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learning [14]

Language is a richer learning medium than sparse scalar rewards; reflection diagnoses problems and proposes prompt updates; evaluation traces are a second source of diagnostic information

https://arxiv.org/abs/2507.19457

Wang et al., arXiv:2601.07349 (2026, preprint) — Reward Modeling from Natural Language Human Feedback [15]

Binary verdicts make generative reward models susceptible to guessing correct outcomes without sound critiques

https://arxiv.org/abs/2601.07349

Xu, Cai, Zhang, Lam and Shi, arXiv:2312.14591 — Reasons to Reject? Aligning Language Models with Judgments [16]

Judgments (language feedback) hold greater potential than scalar rewards for alignment

https://arxiv.org/abs/2312.14591

Xiang Gao and Kamalika Das (Intuit AI Research), AAAI 2024 — Customizing Language Model Responses with Contrastive In-Context Learning [17]

For a style or tone that is hard to describe, positive and negative examples together significantly outperform standard few-shot prompting

https://arxiv.org/abs/2401.17390

Zhang et al. (Stanford, SambaNova, UC Berkeley), arXiv:2510.04618, ICLR 2026 — Agentic Context Engineering: Evolving Contexts for Self-Improving Language Models [18]

Context collapse, where iterative rewriting erodes details over time; structured, incremental updates preserve detailed knowledge

https://arxiv.org/abs/2510.04618

Leo Gao, John Schulman and Jacob Hilton, arXiv:2210.10760 (2022) — Scaling Laws for Reward Model Overoptimization [20]

Optimising an imperfect reward model too much can hinder ground-truth performance, in accordance with Goodhart's law

https://arxiv.org/abs/2210.10760

Anil R. Doshi and Oliver P. Hauser, Science Advances 10(28), 2024 — Generative AI enhances individual creativity but reduces the collective diversity of novel content [21]

AI-enabled stories were rated more creative but were more similar to each other; individual creativity rises at the risk of losing collective novelty

https://discovery.ucl.ac.uk/id/eprint/10195027/

Krol and McCormack (SensiLab, Monash University), arXiv:2606.00112, May 2026, preprint — Evolving to the Aesthetics of a Vision-Language Model [22]

The artist remarked that the models felt overly general rather than tailored to their aesthetic sensibilities

https://arxiv.org/abs/2606.00112

B. F. Skinner, Journal of Experimental Psychology 38 (1948) — 'Superstition' in the Pigeon [23]

A few accidental connections between a ritual and favourable consequences suffice to set up and maintain the behaviour in spite of many unreinforced instances

http://psychclassics.yorku.ca/Skinner/Pigeon/

Colin Camerer, George Loewenstein and Martin Weber, Journal of Political Economy 97(5), 1989 — The Curse of Knowledge in Economic Settings: An Experimental Analysis [24]

Better-informed agents are unable to ignore private information even when it is in their interest; market forces reduce the curse by about 50 percent but do not eliminate it

https://www.cmu.edu/dietrich/sds/docs/loewenstein/CurseknowledgeEconSet.pdf

Jadhav, Beriwala and Kim, arXiv:2609.27110, September 2026, preprint — Feed the Panel Dimensions, Not Verdicts [25]

A panel of holistic judges never significantly beats its best member, whether verdicts are averaged or fused

https://arxiv.org/abs/2609.27110

Amidon, Composition Forum 49, Summer 2022 — Troubling the Tacit: A Review Essay of Harry Collins's (2010) Tacit and Explicit Knowledge [26]

Relational tacit knowledge could be made explicit but is not; sub-forms include ostensible knowledge, mismatched saliences and unrecognized knowledge

https://compositionforum.com/issue/49/amidon-collins-review.php

Weger, Castle and Emmett, International Journal of Listening 24(1), 2010 — Active Listening in Peer Interviews: The Influence of Message Paraphrasing on Perceptions of Listening Skill [28]

180 participants; message paraphrases were associated with the social attractiveness of the listener but not with conversational satisfaction or feeling understood

https://eric.ed.gov/?id=EJ910765

Oinas-Kukkonen, Pohjolainen and Agyei, Frontiers in Artificial Intelligence, 2022 — Mitigating Issues With/of/for True Personalization [29]

Using a user's name without offering personalized features is fake personalization, in other words not personalization at all

https://www.frontiersin.org/journals/artificial-intelligence/articles/10.3389/frai.2022.844817/full

Daniel L. Schwartz and Taylor Martin, Cognition and Instruction 22(2), 2004 — Inventing to Prepare for Future Learning [30]

Tell-and-practice matched invention on transfer without a learning resource, but invention did better when a learning resource was available; most tests are sequestered problem solving

https://aaalab.stanford.edu/assets/papers/2004/Inventing_to_prepare_for_future_learning.pdf

Industry Analysis & Vendor Research

Anthropic Engineering, 16 October 2025 — Equipping agents for the real world with Agent Skills [6]

Iterate and capture successful approaches and mistakes into a skill to discover what context the model actually needs, instead of trying to anticipate it upfront

https://www.anthropic.com/engineering/equipping-agents-for-the-real-world-with-agent-skills

Adobe (Claudia de Lavalle), 22 June 2026, vendor-described architecture — How AI brand validation catches what style guides miss [7]

The system learns from decision traces including comments, edits, rejected versions and final approvals; Validate uses campaign briefs and intended audiences and links issues back to guidelines or prior decisions

https://business.adobe.com/blog/scale-brand-consistency-with-adobe-brand-intelligence

Adobe (Adrienne Tsai), 20 April 2026, vendor-described — What is brand ontology? How Adobe Brand Intelligence learns your brand [8]

Brand decisions are shaped by context, taste and experience; guidelines try to capture them, sometimes across hundreds of pages, but they never go far enough

https://business.adobe.com/blog/adobe-brand-intelligence-shaping-agentic-marketing

Prithvi Rajasekaran, Anthropic Engineering, 24 March 2026 — Harness design for long-running application development [9]

Aesthetics can't be fully reduced to a score, but grading criteria that encode principles give the model something concrete to grade against

https://www.anthropic.com/engineering/harness-design-long-running-apps

Hamel Husain, hamel.dev, 29 October 2024 — Creating a LLM-as-a-Judge That Drives Business Results [19]

You cannot write a good judge prompt until you've seen the data; deciding pass or fail compels domain experts to articulate expectations and uncovers unspoken assumptions

https://hamel.dev/blog/posts/llm-judge/

Ahpra and National Boards, issued 2 September 2025 — Guidelines for advertising higher risk non-surgical cosmetic procedures [27]

Advertising of higher risk cosmetic procedures must not use testimonials; before-and-after images may create unrealistic expectations and must be genuine images of actual patients, unedited, with a prominent warning

https://www.ahpra.gov.au/Resources/Cosmetic-surgery-hub/Cosmetic-procedure-advertising-guidelines.aspx

About This Reference List

Compiled September 2026. All URLs verified at time of compilation. Regulatory documents and standards specifications are subject to revision — check primary sources for the most current versions.

Some links to academic papers and vendor research may require free registration. Government and standards body publications are freely accessible.

Contents

Eight parts, twenty-eight chapters, and the references.