Experience · Domain priors · Process priors

Experience Is Compressed Priors — and You Can Now Record Both Kinds

“Have you done this before?” is really asking whether you carry compressed domain priors and process priors. AI-era co-design produces both streams on every serious project — and for the first time you can record them as replayable artefacts that make each other faster.

Scott Farrell · LeverageAI · Sharpens the experience leg of the AI Learning Flywheel

In brief

I was designing a personal news radar — the kind of system that watches sources, holds unresolved attention in a queue, and tries not to spam you — and I noticed something stranger than the product itself. I was getting domain learning and process learning at the same time. What is true about systems like this. And how you find that out when you cannot fully specify the design up front. And I guess this is what people call experience.

Not the résumé line. The real thing underneath it.

Here is the funny thing about that hiring question — “Have you implemented that before?” — once you look at it while co-designing with AI. They are not only asking whether you have touched the stack. They are asking whether you carry compressed priors that change what you notice and what you do next. Hidden failure shapes. Distinctions that matter early. Paths that look reasonable and become traps. A method for discovering the unknowns you cannot name yet.

Experience is not merely having done something before. It is carrying forward compressed domain priors and process priors that change what you notice and what you do next.

The new fact is not that experience exists. The new fact is that AI-era practice lets you record both kinds — as files, traces, rejected designs, architecture decisions and frameworks — so the next project starts higher than this one ended. Most of that used to stay tacit. Industry reporting on professional services still puts the bulk of firm expertise in people’s heads, rarely written down.1 Polanyi’s old line still holds: we know more than we can tell — until we perform it, and even then we often do not write the performance down.2

This piece is the cross-project claim. The per-project design loop that turns usage into design evidence lives in a sibling; I will point you there and not re-teach it.3 The general learning flywheel — engagement upgrades your thinking — is already published; this sharpens what the “experience” upgrade is made of.4

Two assets fall out of one conversation

Midway through the radar work I said something I had been feeling for a while: I am designing a new project, but I am also watching the co-authoring of the design process with AI. Out of the same conversation falls a system and a method. Two assets. The second may be more general than the first.

That is not a branding slogan. It is a description of what the work was doing.

rough human shape → AI supplies priors and formal structure → outside examples perturb the model → human recognises what is still wrong → thin implementation meets reality → traces expose hidden requirements → learning is promoted out of the patch → design changes

I could not completely explain what I wanted at the start. I had the shape of it. Outside influences — other products, prior wiki thinking, real multi-source stories — forced redraws. The advances were perturbation, not pure decomposition. If you only look at the repo afterwards, you miss half of what was produced: the method for getting to a design when neither party can fully specify the answer up front.

That is the second asset. Treat it as optional meta-work and it evaporates into chat history. Treat it as experience and it compounds.

Domain priors and process priors

Every serious project produces two learning streams. They look similar in the heat of the work. They are not the same object when you file them.

Domain learning — what is true about systems like this

For the radar, domain priors looked like this:

Those are claims about the problem world. Once you have them, you notice different things. You stop treating every tweet as a ticket. You stop treating every repository as a new story. You start asking what would make two observations the same case — and when one case becomes two.

That grain is the domain of the signal-case queue. I will not rebuild the queue here. I need only the shape of a domain prior: a distinction that, once compressed, changes the next design move.

Process learning — how you discover what you do not know

The other stream is about method:

Those are claims about discovery under AI co-design. They change how you run the next unknown. They are closer to what organisational theorists called double-loop learning: not only correcting errors under fixed rules, but questioning the governing variables — the goals and decision rules themselves — when experience shows the frame is wrong.5

Chris Argyris’s thermostat still works as a picture. Single-loop turns the heat on when the room drops below the set point. Double-loop asks why the set point is what it is.5 Process priors are how you get better at asking that second question with an AI that can supply historical structure, while you supply direction, taste, and the recognition of what is still wrong.

The split that matters

Domain priors change what you try. Process priors change how you try. Capture only one and you have half an experience corpus.

The double flywheel

The streams do not sit side by side. They accelerate each other.

better domain model ↓ better design experiments ↓ better process for learning ↓ faster discovery of the domain

A sharper domain model lets you design better probes. Better probes produce cleaner surprises. Cleaner surprises improve the process you use next time. The improved process discovers the next domain distinction faster. That is more than “learning while doing.” It is why recording both streams is not bureaucracy — it is how the pair compounds.

Organisational research keeps rediscovering a related point at firm scale: tools and talent are not enough; benefits show up when humans and machines learn from each other over time.6 Firms that couple organisational learning with AI — so-called Augmented Learners in one MIT SMR / BCG line of work — are reported as substantially more effective at handling external uncertainty than limited learners.7 I am not importing their survey into a solo design project. I am pointing at the same structural fact: learning infrastructure is not a nice-to-have wrapper around AI. It is the layer where experience stops evaporating.

The model will not remember your project for you. Session context is not organisational learning. If the priors are going to survive, they have to land in files the next loop can load.

Proof from one project: an ADR and a process rule

Abstracts are cheap. The brief’s minimum proof is one project yielding both streams with a concrete artefact for each. The radar conversation did that in the open.

Domain artefact — ADR-class decision

Decision: A queue case is an open hypothesis about a bounded developing episode — not a timeless concept and not an individual source object.

That is an architecture decision record in plain language. It is domain learning compressed into a rule you can defend, replay, and violate on purpose later if evidence demands it.

Supporting distinctions that fell out of the same work:

CONCEPT — enduring subject in durable memory CASE — bounded developing episode under active interpretation CASCADE — observable propagation and influence lineage

Those may not need three storage engines. They need three ideas. Without them the queue becomes either too broad to resolve or too narrow to accumulate meaning. With them, future design moves start from a sharper prior: you already know the grain of the thing you are building.

Domain artefact (example form)

Title: Case identity is episodic, not post-shaped.
Context: Multi-source AI-news radar with wiki grounding.
Decision: Queue units are signal cases (bounded developing episodes), not raw posts.
Consequences: Merge/split/reopen become first-class; engagement without adoption does not automatically create importance; concept pages stay out of the live queue.

That is the kind of thing a résumé “experience” claim is actually pointing at — whether you have already paid for that distinction.

Process artefact — a rule for discovery

Rule: When the design is still open-ended, the next move is collision with reality and outside perturbation — not another abstract decomposition of fields you have not earned yet.

In the radar conversation that looked like: take real multi-source stories, feed observations serially, force the system (or the design) to choose attach / create / merge / split / resolve — and ask, at each step, what the case is claiming and what would make it a separate case. The point of the exercise was not a database schema. It was a Case Boundary and Lifecycle Contract discovered through serial contact, not invented in a vacuum.

A second process prior, tightly related: build early enough to learn, but never let the code become the only place where the learning lives. Patches that only exist in the implementation are experience you rented once. Promotions into design, ADRs, rejected alternatives and process rules are experience you own.

Process artefact (example form)

Title: Open-ended design advances by perturbation, not pure decomposition.
Trigger: You cannot yet name the correct sub-problems.
Move: Hold a coherent design model; collide it with outside examples and thin reality; promote surprises into the design before regenerating.
Never-again: Spawning a tree of autonomous sub-designs before the grain of the problem is known.

The full workshop that operationalises serial design replay is Replay-Driven Design Evolution. This article only needs the process prior as an artefact — a rule you can hand to your future self, or to an AI, at the start of the next unknown.

What “have you done this before?” is really auditing

Read the interview question as a priors audit:

What they ask What they mean What you can now show
Have you implemented this before? Have you met its failure shapes? Domain ADRs and rejected designs
How long have you been in this space? Do you recognise distinctions early? Domain priors that change notice
How do you approach green-field design? Do you have a method for unknowns? Process rules and replay habits
What would you do differently? Did learning leave the chat log? Promoted artefacts the next loop loads

Years still matter. Contact still matters. The claim is not that files replace scars. The claim is that AI projects produce scar-density so fast that scars without capture become expensive amnesia. You are turning normally tacit advantages into objects that can be replayed — by you, by a teammate, by an agent that needs better priors than the base model’s average.

That is the AI-era twist on second-hand time travel: frameworks and compressed decisions let later work start further along the path someone already walked.8

A two-column capture checklist

You do not need a knowledge-management programme. You need a habit at project phase boundaries — end of a design probe, end of a week, end of a release candidate. Five minutes. Two columns. Route answers into something durable (wiki page, ADR folder, team canon — pick one place and keep using it).

Domain column — systems like this Process column — discovering with AI
What distinction changed what you notice? What move discovered it (perturbation, trace, outside example)?
What failure shape did you meet? What rule would avoid re-meeting it blind?
What would you put in an ADR this week? What would you put in a process card this week?
What did you reject, and why (domain)? What method did you reject, and why (process)?
What prior would speed the next similar system? What prior would speed the next unknown design?

If you only fill the left column, you get smarter product facts and the same chaotic discovery next time. If you only fill the right column, you get methodology without domain teeth. The double flywheel needs both deposits.

This is a lighter, dual-stream version of a learning extraction ritual: sticking points, surprises, never-agains — sorted so domain and process do not collapse into one vague “lessons learned” paragraph.

The compounding test

At the end of a project, ask one question:

Did we leave merely another codebase — or a sharper dual-stream corpus that makes the next project easier and better?

A loop that piles findings into chat history is linear activity. A loop whose outputs become structured substrate the next loop reads as priors is compounding — the difference between an activity and an asset.9

Code is still important. Under AI, it is also regenerable. The durable intellectual capital is the architecture and the learning from which fitting code can be generated again — including the process learning that tells you how to run the generation when you do not yet know the answer.

The same radar work, viewed from another angle, is about a private corpus that gets more discriminating over time.10 This piece is not that defensibility argument. It is the prior layer underneath: what experience is, when both streams are named, and how a builder records them before the conversation ends.

What to do on the next project

  1. Name the two streams early. Mid-project, say out loud: we are learning domain X and process Y. If you cannot name both, one is still invisible.
  2. Write one ADR-class domain decision before you “feel done.” Not a novel — a decision, context, consequences.
  3. Write one process rule that would change how you start the next unknown. Put it where your future self (or agent) will load it.
  4. Keep rejected designs. The path not taken is domain and process evidence, not clutter.
  5. Run the two-column checklist at phase ends. Empty cells are a smell.
  6. Pass the compounding test before you call the project finished.

I will not pretend this is glamorous. It is the opposite of glamorous. It is how experience stops being a story you tell about yourself and becomes a corpus that compounds.

Have you done this before? Good. Show me the priors — both kinds.

References

  1. Starmind. "Unlocking Tacit Knowledge in Consulting Firms: The Hidden Asset." — "up to 90% of a firm’s expertise is tacit knowledge, embedded in consultants’ heads, shaped by years of lived experience, and rarely written down." https://www.starmind.com/blog/unlocking-tacit-knowledge-in-consulting-firms
  2. Polanyi, Michael. The Tacit Dimension (classic formulation "we know more than we can tell"); medical-education discussion of experts often unaware of the full scope of what they know until they perform it. https://en.wikipedia.org/wiki/Tacit_knowledge · https://pmc.ncbi.nlm.nih.gov/articles/PMC12927663
  3. Scott Farrell / LeverageAI. "Replay-Driven Design Evolution." — Per-project design loop (generate designs → replay against recorded history → mutate); process method owned by sibling, not restated here. https://leverageai.com.au/wp-content/media/articles/145-replay-driven-design-evolution.html
  4. Scott Farrell / LeverageAI. "The AI Learning Flywheel." — Sustained critical AI engagement upgrades thinking and prompting; this article sharpens the experience substrate (domain + process priors). https://leverageai.com.au/wp-content/media/articles/07-ai-learning-flywheel.html
  5. Argyris, Chris. Double-loop learning: modification of goals or decision-making rules in light of experience; thermostat analogy in "Teaching Smart People How To Learn," Harvard Business Review (1991). https://en.wikipedia.org/wiki/Double-loop_learning
  6. Ransbotham, S. et al. "Expanding AI’s Impact With Organizational Learning." MIT Sloan Management Review / BCG. — "Only 10% of companies obtain significant financial benefits from artificial intelligence technologies"; mutual learning between humans and machines over time. https://sloanreview.mit.edu/projects/expanding-ais-impact-with-organizational-learning/
  7. Candelon, F. et al. "How to make the most of AI for your organizational learning." Fortune (6 Dec 2024). — "Augmented Learners are 60%-80% more likely to be effective at managing uncertainties… than Limited Learners." https://fortune.com/2024/12/06/ai-augmented-learners-organizational-learning/
  8. Scott Farrell / LeverageAI. "Frameworks: Second-Hand Time Travel." — Frameworks as compression artefacts that let later work start further along a path already walked. https://leverageai.com.au/wp-content/media/articles/131-frameworks-second-hand-time-travel.html
  9. LeverageAI internal concept (Compounding Test): a loop whose output becomes structured substrate the next loop reads as priors is compounding — activity vs asset. Operational criterion discussed across designing-loops / blueprint material; applied here to dual-stream experience capture.
  10. Scott Farrell / LeverageAI. "The Moat Is the Memory." — Same radar project; defensibility via private discriminating corpus (different claim from this experience-priors piece). https://leverageai.com.au/wp-content/media/articles/149-the-moat-is-the-memory.html
  11. Scott Farrell / LeverageAI. "The Signal Case Queue." — Domain parent for case grain (cases as bounded episodes competing for attention). https://leverageai.com.au/wp-content/media/articles/143-signal-case-queue.html