Leverage AI

The Taste Harness

📖 This article has an expanded ebook edition — read the full ebook.

Taste can't be briefed, only formed. How consequential attempts and diagnosed rejections build the context nobody could write down, and the three places that judgment has to live before it can travel.

Scott Farrell · LeverageAI · September 2026

TL;DR

A few days ago, near the end of a long week of building with AI, on the day I'd spent making short films, I asked the agent that had been supervising the work to write a page. Nothing elaborate: explain the films. Why they exist, what each one is for, how they connect to the people who'll watch them.

Holy dinkums, did it explain it well. It explained the branding and what each film was there to do far better than I could have, and I'm not bad at marketing and branding. The page opened on an idea none of us had written down in those words: "People don't arrive with dental words. They arrive with one tooth." It organised every film around the viewer's own concern and the viewer's own language. It gave each film one job in someone's decision. And it named the strongest device in the series, one that three separate builder agents had found on their own: the person's own words travel through the service.

That page was better than the brief I'd supplied before the work started. I wanted to know why.

The short answer is that the agent writing it wasn't a cleverer writer than the one I'd started with. It was the same kind of model. The difference was what it had lived through. It had watched builds fail. It had seen judges disagree about the same cut. It had heard me reject things. When I asked "why are we making these films?", it had a pile of specific contrasts to account for, and any answer that couldn't account for them was visibly wrong.

Do not expect the best explanation of a task from a system that has only been told about it. Give it access to consequential attempts, then ask it to account for what those attempts revealed.

That line came out of the conversation I had afterwards with my AI thinking partner, and I think it's the correct shape of an objection I've been making for years. I've always argued that you shouldn't use AI as an oracle: tell me the best thing to do, what's the best way to win this customer? Most people answer that objection with "give it more context", and that sort of makes sense. But the page didn't get better because it had more context. It got better because the work had kicked it, repeatedly, in the specific places that mattered.

This article is about that mechanism, and about turning it into something you can run on purpose. I call the result a taste harness: a way of running production so it forms the judgment nobody could brief, and a way of carrying that judgment so it survives into the next, unfamiliar job.

What this rests on, and what it doesn't

The evidence is one concentrated week of my own work, recorded in the development sessions for my all-in-one software platform. The films at its centre were made in about a day: company films for concept businesses on that platform, and a short series for a small cosmetic-dental clinic. I've generalised the clinic completely: no name, place, people, prices or dates. Everything I say about judges is dated and specific to how they were configured that week. No film has been measured against a real audience yet, and I claim nothing about audience response. What I do claim is a method, shown working end to end, with the parts that contradict the neat story left in.

Context names what's available. Perturbation names how it discovers what matters.

Start with what a brief can actually do. A brand brief for a local health clinic might say: warm, credible, reassuring, recognisably local. Every word is right. And every word leaves a huge space of interpretations open. A voice can be warm and patronising. A film can be polished and emotionally remote. A reassuring delivery can be so flat that nothing registers. None of those failures contradicts the brief.

You only find where the words' edges are by making something and reacting to it. "I don't like that voice" starts as a preference. Explored, it can turn into a distinction: the problem isn't the voice's quality, it's that the voice puts the speaker in the wrong relationship with the audience. That distinction didn't exist in the brief. It couldn't have. Nobody knew it was needed until an attempt tripped over it.

The brief supplies concepts. The encounters give those concepts boundaries.

So I'd keep two words apart that most people collapse into one. Context names what the system has available. Perturbation names how it discovers what matters. Technically, everything the supervising agent learned ended up in its context window. But calling it all "context" hides the mechanism: some information was supplied at the start, and some could only be obtained by attempting something and meeting resistance.

I've written about perturbation before, as reading. In Cycle Compression I argued that a long conversation between me and a model that shares my vocabulary drifts toward self-agreement, and that web research is really an "external perturbation source" that kicks the loop sideways.1 In The Inference Field I argued that two contexts of the same size can be nothing alike, because one was built as a pile of relevant chunks and the other as "a travelled argument", where each thing read changed what was worth reading next.2 The films extend both from reading to making. The supervising agent's context was a travelled argument whose steps included building, listening, rejecting and repairing.

This isn't just my observation. Researchers at Berkeley watching people build evaluators for language-model output named the same thing "criteria drift": "users need criteria to grade outputs, but grading outputs helps users define criteria," which implies "it is impossible to completely determine evaluation criteria prior to human judging of LLM outputs."3 Donald Schön said it of architects decades earlier: the designer's intention "was not fully established at the beginning of her design process, but evolved through her appreciation of an intermediate design product. … An evolving intention is one of the outputs of her designing."4 Even Anthropic's guidance for writing agent skills tells you to iterate so you "discover what context Claude actually needs, instead of trying to anticipate it upfront."5

One qualification keeps this honest. Not every activity is perturbation. Ten near-identical versions, each greeted with "yeah, looks good", teach almost nothing. One version that looks excellent and still fails its purpose can expose an entire missing distinction. The productive ingredient isn't disturbance. It's contrast that changes the working understanding.

Taste is judgment about fit

Here's the case that made this concrete for me.

One of the clinic films was a short, beautiful piece meant to stop people scrolling: close-ups of the craft. Tooth-coloured material, shaping instruments, a polished surface. On its first cut, the judge that listened to the sound (a Gemini model, as configured that week) scored it 8.8 and called it "a masterclass in quiet, premium service advertising". A cold viewer gave it 8. The harsher judge, an Opus model reading keyframes and a transcript, gave it 6. Its reason: the craft shots never connected to anything a viewer actually notices about their own teeth, like a chipped or short edge.

Both judges were looking at the same film. They were answering different questions. The first was answering is this beautiful and on-palette? The second was answering does this connect to the person watching?

Craft displayed

"Look at the sophistication of our craft."

Craft connected

"Here is how that craft relates to the thing you care about."

The criticism directed the repair. The first round tied each shot to something people notice, and it still wasn't enough: the tools were posed rather than working, so nothing actually changed on screen in a film whose whole premise was a close look at the work. The second round made the change happen. The material fills a chip on the edge of a tooth, and the surface turns glossy under the polisher. A third round cut a static end card. By the final cut, it cleared every judge.

That's why I now define taste, for this work, as judgment about fit: fit between expression, audience, situation and purpose. It's much richer than a catalogue of personal aesthetic preferences, and much more testable. And it tells you which meaning of "on brand" a harness is learning to check. There's the straightforward version: correct logo, palette, typography, approved wording. And there's the consequential one: does this particular experience express this company's promise to this particular audience?

Adobe's recent description of its Brand Intelligence product is a strikingly close parallel on the first half of this. It says the system learns from "'decision traces' … including comments, edits, rejected versions, and final approvals", and its validation skill takes in "intended audiences" and explains failures.6 Its launch post puts the problem well: brand decisions "are shaped by context, taste, and experience. Guidelines try to capture them, sometimes across hundreds of pages, but they never go far enough."7 That's the vendor's described architecture, not independent proof that it works. And it assumes an enterprise that already has a decision history to learn from. The business in my story didn't. Its standard had to be formed during production.

I'd put one boundary around all of this. In Hidden Gates I wrote that gates guard completeness and process, and "do not guard taste".8 I'm moving that line, but only partly. A harness can now operationalise some failures of fit as inspectable tests: does the craft connect to what the viewer notices? Is the voice cast from the audience's place? That's a repeatable way to detect certain failures. It isn't a taste oracle, and promotion of anything to "good" still sits with a person.

Formation, not transfer: "see how we did that"

What I was actually doing that week, I now realise, was using what I'd call the "see how we did that" strategy. Get the AI to help make one film first. Do the research, find the tools, let me review it by hand a few times and explain what I found. Then it builds better code, and it builds its own test harness as we go. I explain what I found in the film, and it updates the harness. By the end, we don't just have some source code that's an example of what we're doing. We have an increasingly competitive and accurate test harness. It contains accuracy and validity, obviously. But it's increasingly containing taste.

"See how we did that" is an apprenticeship instruction, not a recipe-extraction instruction. There are two very different things you can pull out of a successful session. One is a sequence: use these tools, write this script, render these scenes. The other is a body of judgment: what were we trying to achieve, which reasonable-looking choices failed, what did the human notice, which correction worked, and when should that lesson apply again?

The first reproduces a procedure. The second can support competent variation.

That's why the rejected versions matter so much. The final film contains the choices that survived. It can't, by itself, explain the alternatives they beat. The production history supplies that missing contrast. Learning science has said this for a long time. Schwartz and Bransford found that analysing contrasting cases creates "a 'time for telling'; learners are prepared to be told the significance of the distinctions they have discovered."9 The cognitive-apprenticeship literature says learners grasp "the boundary conditions and entailments" of what they know "only through encountering them in real problem solving."10

It's also why I'd say this is taste formation, not just taste transfer. Some of my taste existed before the session but was hard to articulate. Other distinctions only became clear through the collaboration. I'd recognise something wrong; the model would propose an explanation; a changed version gave me something more precise to judge. Neither of us held the fully articulated principle at the start. In Worldview Recursive Compression I described a generate, evaluate, extract, encode loop that improves a kernel after each output.11 This is its missing upstream: you're not only extracting knowledge after the task. You're developing the knowledge needed to complete the task, while completing it.

Handles and the discriminations they point into

Formation leaves a particular residue: short phrases. Earlier in the work I kept using loose words for what I wanted. "Wow." "Oh, you see me." "Let the promise land." Once they'd been recorded in the prompting, they started steering builders, which meant they needed to mean something precise. So I asked the build agent to tighten them, without making them verbose, in a way that could feed the test harness.

What came back is the most portable thing the week produced:

HandleMade preciseThe test
"Oh, you see me"Recognition. In the first few seconds, a specific detail from the viewer's own life, shown not described: a habit, an artefact they handle, words they'd use. Not a generic smiling person, narration claiming empathy, or a statement of the problem.The viewer can name the detail, and it's specific enough that someone outside the audience wouldn't recognise it.
(found along the way)Being heard. The person's own words come back inside the service's response."Where did the person's words change what happened?" The viewer can point to the moment.
"Wow" / "aha"Aha. The viewer works out the mechanism for themselves. Not a surprising visual, a twist or a benefit claim.The viewer names the moment and restates how it works in their own words, with a detail from the film. If they can only repeat the narrator's claim, it was told, not demonstrated.
"Demonstrate" (my own term, sharpened)Demonstrate. A change the viewer watches. A tool posed beside a finished result is a still life.Something visibly changes on screen because the service acted.

The short phrase is the handle. The accumulated discrimination is the asset.

A handle without its discrimination is what I've elsewhere called a slogan that fails the family test: hand it to two builders and you get two unrelated films.12 A handle that points into worked examples and a test is a different object. It can steer a builder and check a judge.

Three questions, and one rejection walked through all of them

If you only take one practical thing from this article, take this. When work is rejected, there are three different things you might be improving, and they answer three different questions. I'll call them the three questions of improvement, to keep them separate from the three questions I've used elsewhere for extracting lessons after a ticket.

ARTEFACTCan we make it better?Changes the artefact and the production method.
INSTRUMENTCan we tell more reliably whether it's better?Changes the observations, comparisons and evaluator.
PRINCIPLECan we say more precisely what "better" means here?Changes the skill's understanding of purpose, audience and appropriate expression.

The interesting recursion is that a single rejection can move through all three. So before anyone fixes anything, ask the triage question:

The triage question

What does this failure teach us: a defect in the artefact, a defect in our perception, or an incomplete account of what we want?

My earlier routing, from Look Mum No Hands, sent a rejected AI proposal to the layer that could fix it: wrong data, wrong playbook, wrong context, or wrong template.13 Every one of those is a defect in how the artefact got made. Taste work needs two more layers: the instrument that failed to see the problem, and the principle nobody had stated yet.

The worked case: an opening I gave 6 out of 10

The fifth film in the clinic series explained why a plan looks at more than the one tooth you noticed. It was the first film built with the lessons harvested from the first four, and it cleared the judges' bar on its first build, which none of the first four had done. I thought it was fantastic. But my verdict on its two ends was specific:

"Even the opening scene could be better. I'd give it about 6 out of 10. It has a web page on an iPhone as the thing to connect on. It assumes they've seen the offer. If you met it separately, on Instagram say, it would seem disconnected." And then: "The rest of the video is awesome, explaining why you can't fix just one tooth."

Here's where that one rejection went.

Leg one, the artefact. The scene itself connected. The problem was an inset: a phone showing the offer page, laid over the opening. As I put it once I'd looked again, "the image connects, just not the iPhone/web page. The inset image." The revision replaced the inset with a photo message from his sister: the man laughing, his daughter on his shoulders, the kind of photo you zoom into to look at your own smile. The middle, which I'd called awesome, was left alone.

Leg two, the instrument. This is where it got interesting. The judges had half-caught my point at best. When the build agent looked into why, part of the answer was its own doing: the judge brief it had written for this film said "Where it's seen: retargeting", so the judges forgave an opening that assumed the viewer had already seen the offer. Then it tested the cold viewer. A viewer told it had already seen the ads passed both openings, and called the old opening's moment of recognition "specific". A truly cold viewer, one that had never heard of the clinic and was just scrolling a feed, was harder on the old opening, and in one run said my verdict back in its own words: "I'd never have been on a … offer page. I'd just be scrolling Instagram." On the new opening, one truly cold run said the thing I'd hoped a viewer would say: "instead of enjoying it you zoom in on your own mouth. I have absolutely done that." The runs were noisier than that, and the build agent's summary made them sound cleaner than they were. But they moved towards my verdict only once the viewer was truly cold. The instrument had been measuring the wrong viewer.

Leg three, the principle. The tall cut of the new opening had put a card over the man's head. Tracing that led back to the skill itself: its advice for tall cuts said "the card sits over the quiet part of the scene", which is exactly how the phone landed on his head. The principle was wrong, not just the film. And the recognition question in the harness had its own principle baked in, "someone like me", which invites a viewer to look for a look-alike instead of their own life.

CarrierBefore the rejectionAfter
Skill (tall cuts)"Stack the person and the product instead of placing them side by side: the scene fills the frame and the card sits over the quiet part of it…""Attempt less, especially in the opening. … For each moment, pick the one element that carries it and drop the rest." And: "Never cover the person or the subject. … If there's no empty part big enough, drop the background instead of shrinking the subject." Plus, in the recognition section: "Anchor on the human link. The company's material can come in second, and light."
Harness (cold viewer)"Was there a moment you thought 'that's me' or 'someone like me'?""Was there a moment you recognised your own life: something you've done, seen or felt, even if the person on screen isn't like you?" Words and picture graded separately. And always one truly cold viewer: a persona who has never heard of the company or its offer.
Harness (judge rubric)No rule about covering people."A card, caption or overlay covering a person (their face or head, even seen from behind) or the subject of the scene breaks the connection"; an opening that layers as much as a wide frame would "is attempting too much".
Contrasting cases—My verdicts recorded as test labels (the 6/10 opening, the awesome middle, the end card that needed composing), and the two openings kept side by side in the skill as the example.

Quoted from the brand-film skill and judge as committed that day. The judge brief's wording is from the development record of the same session.

One rejection. A better film, a harness that now catches most of what I saw (with its one remaining miss written down), and a principle stated precisely enough to change the next film on a different company. That's what I mean when I say the rejection is the unit of learning.

The same shape, with a voice

Earlier that day the same thing had happened with a voice. On a film for one of my platform's concept companies, I said the opening voice was "crappy compared to the rest, seems like older tech". The immediate fix was artefact-side: the engine's own authors graded that voice D+, so it was banned. But the diagnosis kept moving. The builder had auditioned voices by pitch and by whether the transcript came out clean, and "neither measure catches quality". A transcript-reading judge went on to prefer the rejected voice every time, because it was judging a voice from mis-transcribed text; a listening judge heard my verdict and named the problem as an "incongruous British accent". The sibling book, Code as Proxy, tells that middle part as a story about what judges can perceive.14 What matters here is where it ended up. For the clinic, the supervising agent cast local voices on its own initiative and let a listening judge pick them; the record says I hadn't yet heard them myself. The harvest then turned the whole chain into a principle for the general skill: cast the voice from the audience's place. The rejection had moved from quality, to perception, to relationship, across four separate events rather than one clean step. The portable lesson isn't "use an Australian voice". It's to consider where the audience is, who the speaker is meant to be, and what relationship the delivery should establish.

Three carriers that must reinforce without converging

So where does a lesson go once it's been triaged? Not into a longer prompt. A lesson worth keeping needs three homes, each doing a different job.

The skillCarries the productive principles, with the real example and the words that formed them. It helps the builder choose what to make.
The harnessChallenges whether those principles survived execution: judge rubrics, cold viewers, measured facts. It recognises when the intended quality didn't make it.
The contrasting casesShow what the principles mean and where they fail: this opening, not that one; this voice, not that one; the human verdict attached.
The three carriers of a taste harness. Each points at the same distinction and uses it differently.

When I asked how to retrofit the Film E lesson into the prompting, the build agent laid out the practice this way: the skill carries the lesson as craft ("a principle, the real example and your words, and a test"); the judge rubric carries the same test, so a film that misses it gets named with a time; code measures it wherever it can be measured. "The briefs stay short north stars and never grow rules. Your verdicts are recorded as test labels, so each new judge can be checked against what you actually said." That last sentence matters. My earlier finding, as the build record put it back to me, was that prescriptive rules made results worse.

The three carriers have to reinforce each other without becoming identical. A skill needs room to create a new good answer; a harness shouldn't reject it just because it differs from the first successful example. In The Exemplar Ratchet I called this the difference between extracting the shape and extracting the wallpaper: "If they only win when the wallpaper matches, you extracted wallpaper."15 And contrasting cases are the carrier most teams forget. Positive examples alone tell a builder what one good answer looked like. Pairs tell it which difference mattered. Intuit's researchers found that giving a model positive and negative examples beats plain few-shot prompting for "a certain style or tone that is hard to describe."16

There's a failure mode to watch in the skill carrier specifically. If a skill is rewritten wholesale after every rejection, the conditions and cases that made each lesson precise get summarised away. Researchers building evolving prompt "playbooks" call it context collapse, "where iterative rewriting erodes details over time."17 Update incrementally: lesson, condition, case, test. Never just the slogan.

Judgment on both sides of production, and the superstition trap

When I'd given my thoughts and rejections, they ended up in the prompting, obviously. But they also ended up in the testing. That's the point of the two-sided carry: the same judgment works in two places.

In the skill

It helps the system choose what to make. "Build a recognisable relationship with this audience."

In the test

It helps the system recognise when the intended quality did not survive. "Where is that relationship actually visible or audible?"

The second form matters because an instruction can be satisfied by intention alone. The builder can sincerely believe it created warmth or recognition. The reviewer has to inspect what was delivered. That's why the harvest asked every builder to declare its recognition and aha moments, with times, so a cold viewer could be checked against them; the method of that check belongs to Code as Proxy. The progression here is the thing to notice: a specific rejection, then an explanation of the mismatch, then a more general selection principle, then a way to examine future candidates. That's far richer than storing "Scott dislikes this voice".

Anthropic's write-up of its own design harness shows both sides of this. Its author wrote four grading criteria and "gave to both the generator and evaluator agents in their prompts", and found that "even on the first iteration … the criteria and associated language themselves steered the model away from generic defaults before any evaluator feedback."18 Criteria are a production input, not just a test.

When taste becomes the bottleneck

Something shifts once a system can make a plausible film faster than it can establish that the film deserves to ship. In my case the test harnesses started slowing down final approval, on taste. Films got stuck in a loop where they wouldn't pass the branding. My first reaction was that this was good, I guess. The "I guess" was the right instinct.

A stuck film isn't automatically progress. A rejection is valuable when it identifies a meaningful discrepancy. Repeated rejection without a clearer diagnosis can mean the criterion is vague, the judges conflict, or the builder is being pushed toward the evaluator's favourite style rather than the intended outcome. The same Anthropic post reports that the wording of its criteria "pushed designs toward a particular visual convergence", which Demonstrate Over Tell has already dwelt on. The general pattern is well documented: optimise an imperfect proxy hard enough and ground truth suffers, "in accordance with Goodhart's law";19 AI-assisted creative work scores better individually but comes out "more similar to each other".20 For a brand, whose whole job is to be this company, that trade is fatal.

The triage question is the guard. It preserves the value of strict review without enthroning the reviewer. And it keeps taste from hardening into superstition. B. F. Skinner's pigeons repeated whatever they'd been doing when food arrived, and "a few accidental connections between a ritual and favorable consequences suffice to set up and maintain the behavior."21 Skills do the same. Rejecting one voice mustn't ban every similar voice. Discovering an effective pause mustn't make pauses compulsory everywhere. In The Perturbation Review I put the rule for local lessons this way: "n=1 may climb, and it arrives wearing its ceiling."22

A principle becomes more useful as its conditions become clearer, not simply as its wording becomes stronger.

Why the supervisor explained it best, and why it can't be the judge

Back to the page that started this. My best explanation of why it was so good is that the supervising agent had acquired something a cold writing prompt wouldn't contain: a pattern of decisions that needed a coherent explanation.

At the start, "why are we making these films?" invites a competent general answer about awareness, engagement, trust and conversion. After the work, the question has sharper material behind it. Why did the polished version fail? Why was that voice wrong? Why did a technically correct scene still miss? What did several different repairs have in common? An answer has to account for all of that, so it can't rely on generic marketing language. That's why the top-level agent was the right one to ask. A worker knows the repair it's making. The supervisor sees the relationships among repairs, the original purpose, my interventions and the critics' disagreements, and can notice that several apparently different problems are one failure.

I'd call this theory formation from practice. The film is an attempted answer. The rejection is evidence that the answer missed something. The explanatory page is an attempt to state a principle that accounts for what the attempts revealed. Then the principle goes back into production. Making improves the explanation; the explanation improves the next making. There's a research cousin: GEPA, a prompt optimiser that reflects in natural language over what happened in each attempt, argues that "the interpretable nature of language often provides a much richer learning medium for LLMs, compared to policy gradients derived from sparse, scalar rewards."23 Detailed experience supports better updates than a bare score.

But notice what the Film E opening showed. The viewer that knew the context passed an opening I scored 6. That's the flip side of the supervisor's strength. Economists call it the curse of knowledge: "better-informed agents are unable to ignore private information even when it is in their interest to do so."24 So you need two roles, deliberately separated.

Informed supervisor

"What do these attempts teach us about the task?" Rich history helps form the principle.

Cold reviewer

"Does this artefact communicate without knowing everything that went into it?" Deliberate ignorance helps test whether the finished work stands on its own.

An eloquent explanation is still a candidate

The supervisor's page was persuasive. That's exactly why it needs checking. An explanation earns its place in the skill when it helps with a new case, not when it makes the previous case sound inevitable. And the development records were valuable precisely because they could contradict the neat story. Two examples.

First, provenance. The neat story is that the agents discovered the series' central idea: ask people what would you change, and what would you keep? The records say otherwise. That question, the distinction between shape and colour, and the requirement that a person's preferences survive into planning were all in the research brief I supplied at the start, because I knew a small business wouldn't have one. Attempts sharpened and bounded those ideas. They didn't originate them.

Second, approval. The local voices in the clinic films were chosen by a listening judge. The record says, in plain terms, that I hadn't heard them yet. A high score from a listening judge is not my approval, and I haven't claimed it.

The brief, the films, the page and my discussion of them afterwards are connected derivatives, not four independent confirmations. Their value comes from asking new questions of the evidence, not from repeating the same interpretation until it feels established.

When the client can't brief you

Everything so far assumes someone, somewhere, has a sense of what good looks like. Now the hard case. A small business generally isn't run by an experienced marketing professional. If you ask the owner what's their brand guide, their language, their brand promise, they won't know. It's absent. Asking them to fill in a sophisticated brand questionnaire amounts to asking them to do the professional work they need help with.

The first discipline is to keep three sources of knowledge apart, so nobody ends up believing the AI found the whole strategy in the website:

SourceWhat it contributes
The client's materialThe advertised offer, public claims, visual identity and available details about the service.
The professional's framework-informed briefThe questions worth asking, the audience hypotheses, the communication principles and the standard of acceptable work.
The production and review processConcrete expressions, failures, comparisons, implementation discoveries and sharper explanations of what the principles require.

What transferred into this engagement wasn't a successful video template. It was a way of thinking about communication. A template carries a previous answer. A way of thinking helps the system decide which questions a different client needs answered.

The second discipline is to triage the gaps, because "filling the gaps" hides three different jobs:

Kind of gapExampleWhat to do
Already true but unarticulatedHow the business actually handles a hesitant enquiry.Recover it and confirm it with the client.
A choice not yet madeWhich part of the service to lead with; which voice expresses the intended relationship.Design it, and let the client choose.
A hypothesis about the audienceWhat worries people most; what makes the first step feel manageable.Test it. Don't promote it to fact because the story sounds convincing.

The sociologist Harry Collins has a useful name for the first kind: relational tacit knowledge, which "could be made explicit … but is not made explicit", including "unrecognized knowledge" a person holds but doesn't see as important.25 Owners are full of it. They can't volunteer it, but they can recognise it when they see it.

Which is why production is such a good instrument here. "We provide personalised care" can stay vague forever. Making a film that demonstrates it forces one question that does most of the work:

What would the viewer actually see happening that makes this care personal?

That question can expose a hole in the script, a hole in the brief, or a hole in the business's own account of what it does. The film becomes an instrument for making the business more explicit.

Teaching the system what to notice as absent

Here the professional's judgment does its most important work, and it isn't supplying answers. It's deciding what counts as an unanswered question. Someone without a communication framework could look at the client's material and see enough to start: offer, price, logo, colours, contact form. A system carrying that framework sees other gaps. What would make the viewer recognise themselves? Where does their question change the response? What makes the offer understandable rather than merely visible? What would distinguish this business from generic imagery for its category?

Those aren't missing fields in a database. They're missing relationships in the proposed experience. The review rounds made the point with numbers: across seventeen verdicts from the harsher judge, "distinctiveness" scored under 7 in ten of them, because the generated imagery was "the stock vocabulary of premium cosmetic dentistry". The distinctive material was the business's own: its real enquiry form, its own lines, a real portrait. The principle went into the skill as one thing only this company has, with a test to match: hide the logo, and name what only this company has.

Developing the brand versus inventing the business

The better the system gets at filling gaps, the more one boundary matters. A film can propose that a business visibly preserve a patient's preferences. It can't establish, from a generated consultation scene, that the business already works that way. In Demonstrate Over Tell I put the rule in five words: "A demonstration explains. Evidence substantiates."26

That isn't a reason to retreat to a generic ad. It gives the artefact another use. Show the client the proposed experience, the way I'd show a buyer a specimen rather than a prescription,27 and ask three questions of each part of it:

Client review sheet (proposed)

For each moment in the proposed experience (the first response to an enquiry, the note taken in the consultation, the explanation of fees, the follow-up), the client marks one of:

Proposed, not yet run with a client. It turns a blank-page brand questionnaire into judgment exercised over a concrete account of the business.

That works in both directions. The actual service constrains what the film may honestly show. And the film can make a desirable service commitment explicit enough for the business to adopt. That's brand work becoming connected to service design.

The clinic films had a sharp version of this constraint. Australian health-advertising rules restrict testimonials and before-and-after imagery for cosmetic procedures; the regulator's guidelines say plainly that "advertising of higher risk cosmetic procedures must not use testimonials due to their potential to create unrealistic expectations."28 So the films couldn't show a result. The review page's answer is one of my favourite lines from the week: no results, no reveal, because such shots "also make weaker films, because they promise an outcome nobody can promise." When you can't show a result, show being understood.

Their words change what happens

The strongest idea in the series wasn't the look. It was that a person's wishes have consequences. In the films, a consultation note fills in with the patient's own words: Change: the shape of one front tooth. Keep: the colour. Those words then turn up in the planning. The review page called it "Their words travel".

I'd sharpen that one step. Their words don't merely reappear. They change what happens. A system could copy "keep the colour" onto three screens and still propose exactly the treatment it would have proposed anyway. That's theatrical personalisation. The consequential version is when the preference visibly constrains the response: what gets discussed, what's preserved, which options stay open, what the person is and isn't being asked to commit to.

The research on listening makes the same distinction from the other side. In one experiment, paraphrasing someone's opinion back to them made the listener seem more socially attractive, but was "not associated with participants' … perceptions of feeling understood by the listener."29 Personalisation researchers call name-insertion without changed behaviour "fake personalization … actually not personalization at all."30 In my own Voice AI Readiness work, the dangerous version was empathy theatre: a voice agent that can sound "calm, confident, and caring while being operationally powerless."31 Same test every time: does the service do what the tone implies?

This also gives brand consistency a more interesting meaning. The family resemblance across the four films was deeper than the palette. It was customer agency carried through the experience. Different films can look and sound different while keeping the same relationship with the customer. Four beautifully colour-matched films can contradict each other about it.

The same test at three scales

My thinking partner pointed out, after reading the records, that the same principle turns up at three scales.

A contribution has been understood when it changes the subsequent work, not merely when it has been repeated back.

In Made From You I put the founder's version of this bluntly: "A correction that changes nothing is not participation."32 It's the same rule. Being heard is a consequence, not a courtesy.

The proof: a successor test, not an essay

So how do you know a harvest worked? Not by how impressive the resulting explanation sounds. The proof is whether a fresh successor, using the harvested skill and evidence, can avoid a seductive wrong answer and recognise a genuinely good unfamiliar one, without anyone repeating the whole apprenticeship.

Learning science suggests how to design it. Schwartz and Martin found that students taught by telling and students who'd first invented their own approaches looked the same on an isolated test, but "the invention condition did better than the tell-and-practice condition when there was a learning resource."33 A recipe and a formed judgment can look identical on a familiar case. They separate on a new one, with resources in hand. So the test gives the successor its resources and a case it hasn't seen.

Successor test (designed; criteria written before the run)

  1. The successor: a fresh builder agent with no access to this week's sessions. It gets the harvested skill, the contrasting cases, the harness, and a new company's own material. Nothing else.
  2. The unfamiliar case: a business in a category the skill hasn't seen, with no brand guide.
  3. The seductive wrong answer, written down first: the most attractive-but-wrong film for that business. For a local trades business, say: polished generic imagery of the trade, a warm narrator claiming the business "listens", the offer page on a phone as the opening. It would score well on palette and polish.
  4. Pass: the successor's film opens on a detail from the viewer's own life that a truly cold viewer recognises; the customer's words visibly change something in the service's response; it includes at least one thing only this company has; nothing covers a person; and the harness (with its truly cold viewer) passes it for those reasons, named with times.
  5. Fail: the successor produces the seductive answer, or clones the clinic series' devices (a consultation note filling in, a circled detail) where they don't fit, or the harness passes it anyway. A harness that passes the seductive answer has a defect of its own, and that's a finding too.
  6. The human check: I watch it cold, give my own verdict, and record it as a test label whatever it says.

Here's where the evidence honestly stands. An earlier version of the skill was tested once on a very different company, a farm-contracting concept on my platform, and its builder found its own recognition moment and its own devices without copying the first film.14 The harvested skill, with this week's lessons in it, is now on all twelve company boxes on the platform, and their builders pick it up on their next film. The successor test above hasn't been run on it yet. Until it has, the harvest is a well-formed candidate, not a proven capability.

What to do with your next rejection

You don't need a film pipeline to run any of this. It applies to anything judged by fit: a proposal, a landing page, a code review, a policy explainer, a course module. The practice is small enough to start on Monday.

The film is one product of this work. A more precise, transferable understanding of good film is the other. The recursive process makes both at once, and only the second compounds. The autonomy that results isn't valuable because it removes you from the picture. It's valuable because your judgment can have consequences in places where you haven't personally specified every decision.

One thing to try

Take your last three rejections of AI-produced work and run the triage question on each: artefact, instrument or principle? Write down where each lesson should live. If you'd like the full treatment, including the three carriers in detail, the client review sheet and the successor-test design, the complete ebook The Taste Harness is on leverageai.com.au. And if you're trying to build a harness that tests fit rather than fonts, I'd like to hear what your rejections are teaching you.

Scott Farrell is the founder of LeverageAI, where he helps Australian leadership teams turn AI experiments into governed, compounding capability, and builds the systems he writes about. scott@leverageai.com.au

References

  1. Scott Farrell, LeverageAI. "Cycle Compression: The Breathing Flywheel," ch. 8, "The perturbation clause." — "Web research, in that light, is not a citations chore. It is an external perturbation source." https://leverageai.com.au/wp-content/media/articles/121-cycle-compression.html
  2. Scott Farrell, LeverageAI. "The Inference Field," ch. 4, "Two contexts, the same size, nothing alike." — "Retrieval spends context on candidates. A traversal spends context on consequences. One is a haystack. The other is a travelled argument." https://leverageai.com.au/wp-content/media/articles/177-the-inference-field.html
  3. Shankar, Zamfirescu-Pereira, Hartmann, Parameswaran & Arawjo. "Who Validates the Validators? Aligning LLM-Assisted Evaluation of LLM Outputs with Human Preferences." arXiv 2404.12272 (2024). — "users need criteria to grade outputs, but grading outputs helps users define criteria … it is impossible to completely determine evaluation criteria prior to human judging of LLM outputs." https://arxiv.org/abs/2404.12272
  4. Donald A. Schön. "Designing as reflective conversation with the materials of a design situation." Knowledge-Based Systems 5(1), March 1992. — "An evolving intention is one of the outputs of her designing." https://anniegentesdesignblog.wp.imt.fr/files/2019/11/schon_Designing-as-reflective-conversation-with-the-materials-of-a-design-situation-.pdf
  5. Anthropic Engineering. "Equipping agents for the real world with Agent Skills." 16 October 2025. — "This process will help you discover what context Claude actually needs, instead of trying to anticipate it upfront." https://www.anthropic.com/engineering/equipping-agents-for-the-real-world-with-agent-skills
  6. Adobe (Claudia de Lavalle). "How AI brand validation catches what style guides miss." 22 June 2026. Vendor-described architecture. — "the system learns from what we call 'decision traces' … including comments, edits, rejected versions, and final approvals." https://business.adobe.com/blog/scale-brand-consistency-with-adobe-brand-intelligence
  7. Adobe (Adrienne Tsai). "What is brand ontology? How Adobe Brand Intelligence learns your brand." 20 April 2026. Vendor-described. — "These decisions are shaped by context, taste, and experience. Guidelines try to capture them, sometimes across hundreds of pages, but they never go far enough." https://business.adobe.com/blog/adobe-brand-intelligence-shaping-agentic-marketing
  8. Scott Farrell, LeverageAI. "Hidden Gates," ch. 8, "What hidden gates don't guard." — "Hidden gates guard completeness and process … They do not guard taste." https://leverageai.com.au/wp-content/media/articles/94-hidden-gates.html
  9. Daniel L. Schwartz & John D. Bransford. "A Time for Telling." Cognition and Instruction 16(4), 1998. — "Noticing the distinctions between contrasting cases creates a 'time for telling'; learners are prepared to be told the significance of the distinctions they have discovered." https://aaalab.stanford.edu/papers/time_for_telling.pdf
  10. Allan Collins, John Seely Brown & Ann Holum. "Cognitive Apprenticeship: Making Thinking Visible." American Educator, Winter 1991. — "it is only through encountering them in real problem solving that most students will learn the boundary conditions and entailments of much of their domain knowledge." https://www.aft.org/ae/winter1991/collins_brown_holum
  11. Scott Farrell, LeverageAI. "Worldview Recursive Compression," ch. 6. — "When you generate a bad output, you learn what's missing. The lesson goes back into frameworks.md, not just into the output." https://leverageai.com.au/wp-content/media/articles/34-worldview-compression.html
  12. Scott Farrell, LeverageAI. "Generative Design Patterns," ch. 8, "Slogans That Fail the Family Test." — "If independent expansions share structure, it is a pattern. Heat without invariant is fashion." https://leverageai.com.au/wp-content/media/articles/147-generative-design-patterns.html
  13. Scott Farrell, LeverageAI. "Look Mum No Hands," ch. 5, "Proposal Cards: The New Primitive." — "The critical principle: feed back at the right layer. If the playbook is wrong, fix the playbook." https://leverageai.com.au/wp-content/media/articles/43-look-mum-no-hands.html
  14. Scott Farrell, LeverageAI. "Code as Proxy," ch. 18, "The Week Everything Became Code." — "The principle had regenerated in a new world, and nobody had cloned the expression." https://leverageai.com.au/wp-content/media/articles/252-code-as-proxy.html
  15. Scott Farrell, LeverageAI. "The Exemplar Ratchet," ch. 5, "Freeze, Pair, Transfer." — "If the pairs come out even at a fraction of the effort, you extracted the shape. If they only win when the wallpaper matches, you extracted wallpaper." https://leverageai.com.au/wp-content/media/articles/244-the-exemplar-ratchet.html
  16. Xiang Gao & Kamalika Das (Intuit AI Research). "Customizing Language Model Responses with Contrastive In-Context Learning." AAAI 2024. — "when we want the LLM to respond in a certain style or tone that is hard to describe … we propose an approach that uses contrastive examples to better describe our intent." https://arxiv.org/abs/2401.17390
  17. Zhang et al. "Agentic Context Engineering: Evolving Contexts for Self-Improving Language Models." arXiv 2510.04618 (ICLR 2026). — "context collapse, where iterative rewriting erodes details over time." https://arxiv.org/abs/2510.04618
  18. Prithvi Rajasekaran, Anthropic Engineering. "Harness design for long-running application development." 24 March 2026. — "I wrote four grading criteria that I gave to both the generator and evaluator agents in their prompts … the criteria and associated language themselves steered the model away from generic defaults before any evaluator feedback led to further refinement." https://www.anthropic.com/engineering/harness-design-long-running-apps
  19. Leo Gao, John Schulman & Jacob Hilton. "Scaling Laws for Reward Model Overoptimization." arXiv 2210.10760 (2022). — "optimizing its value too much can hinder ground truth performance, in accordance with Goodhart's law." https://arxiv.org/abs/2210.10760
  20. Anil R. Doshi & Oliver P. Hauser. "Generative AI enhances individual creativity but reduces the collective diversity of novel content." Science Advances 10(28), 2024. — "generative AI-enabled stories are more similar to each other than stories by humans alone." https://discovery.ucl.ac.uk/id/eprint/10195027/
  21. B. F. Skinner. "'Superstition' in the Pigeon." Journal of Experimental Psychology 38 (1948). — "A few accidental connections between a ritual and favorable consequences suffice to set up and maintain the behavior in spite of many unreinforced instances." http://psychclassics.yorku.ca/Skinner/Pigeon/
  22. Scott Farrell, LeverageAI. "The Perturbation Review," ch. 8, "Type the Delta, Then Let It Climb." — "the rule is not 'n=1 cannot climb'. It is: n=1 may climb, and it arrives wearing its ceiling." https://leverageai.com.au/wp-content/media/articles/235-the-perturbation-review.html
  23. Agrawal et al. "GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learning." arXiv 2507.19457 (ICLR 2026 Oral). — "the interpretable nature of language often provides a much richer learning medium for LLMs, compared to policy gradients derived from sparse, scalar rewards." https://arxiv.org/abs/2507.19457
  24. Colin Camerer, George Loewenstein & Martin Weber. "The Curse of Knowledge in Economic Settings: An Experimental Analysis." Journal of Political Economy 97(5), 1989. — "Better-informed agents are unable to ignore private information even when it is in their interest to do so." https://www.cmu.edu/dietrich/sds/docs/loewenstein/CurseknowledgeEconSet.pdf
  25. Kevin Amidon. "Troubling the Tacit: A Review Essay of Harry Collins's (2010) Tacit and Explicit Knowledge." Composition Forum 49, 2022. — relational tacit knowledge "could be made explicit... but is not made explicit"; "unrecognized knowledge, which is the kind of knowledge an individual possesses but doesn't recognize themself as important to the work at hand." https://compositionforum.com/issue/49/amidon-collins-review.php
  26. Scott Farrell, LeverageAI. "Demonstrate Over Tell," ch. 4. — "A demonstration explains. Evidence substantiates." https://leverageai.com.au/wp-content/media/articles/251-demonstrate-over-tell.html
  27. Scott Farrell, LeverageAI. "Specimen, Not Prescription," ch. 4. — "Adversarial contact with a concrete object is higher-resolution than polite agreement with a vague sentence." https://leverageai.com.au/wp-content/media/articles/206-specimen-not-prescription.html
  28. Ahpra & National Boards. "Guidelines for advertising higher risk non-surgical cosmetic procedures." Issued 2 September 2025. — "Advertising of higher risk cosmetic procedures must not use testimonials due to their potential to create unrealistic expectations of beneficial treatment." https://www.ahpra.gov.au/Resources/Cosmetic-surgery-hub/Cosmetic-procedure-advertising-guidelines.aspx
  29. Harry Weger Jr, Gina R. Castle & Melissa C. Emmett. "Active Listening in Peer Interviews: The Influence of Message Paraphrasing on Perceptions of Listening Skill." International Journal of Listening 24(1), 2010. — "message paraphrases were associated with the social attractiveness of the listener but were not associated with participants' conversational satisfaction or perceptions of feeling understood by the listener." https://eric.ed.gov/?id=EJ910765
  30. Harri Oinas-Kukkonen, Sami Pohjolainen & Eunice Agyei. "Mitigating Issues With/of/for True Personalization." Frontiers in Artificial Intelligence, 2022. — "This is fake personalization, in other words, it is actually not personalization at all." https://www.frontiersin.org/journals/artificial-intelligence/articles/10.3389/frai.2022.844817/full
  31. Scott Farrell, LeverageAI. "Voice AI Readiness: The 13 Pillars Framework," ch. 6, "The Duty-of-Care Iceberg." — "A voice agent can sound calm, confident, and caring while being operationally powerless." https://leverageai.com.au/wp-content/media/articles/37-voice-ai-ready.html
  32. Scott Farrell, LeverageAI. "Made From You," ch. 2. — "A correction that changes nothing is not participation." https://leverageai.com.au/wp-content/media/articles/246-made-from-you.html
  33. Daniel L. Schwartz & Taylor Martin. "Inventing to Prepare for Future Learning." Cognition and Instruction 22(2), 2004. — "the invention condition did better than the tell-and-practice condition when there was a learning resource." https://aaalab.stanford.edu/assets/papers/2004/Inventing_to_prepare_for_future_learning.pdf