Skip to content
C.W.K.
Stream
Lesson 02 of 05 · published

A Review That Rejects Nothing Failed

~12 min · review, evidence, process, judgment

Level 0Wet Clay
0 XP0/36 lessons0/12 achievements
0/100 XP to next level100 XP to go0% complete

The Same Inversion, One Level Up

Start from the base case, stated in one line: given how reliably a first draft contains something worth arguing with, zero findings has two explanations, and the far likelier one is that nobody looked — so an empty log certifies an absence of judgment rather than a presence of quality. That much is settled, and the case for it is made at length in Beacon Quest, for generated assets. What this lesson adds is what happens when the unit being judged is not an asset but a whole round — one reviewer, one artifact, one verdict covering everything at once.

The inversion survives the change of scale and gets sharper. A per-asset judgment that comes back empty is one skipped look. A review round that comes back empty is a claim about an entire body of work, made in a single sentence, by somebody who had no obligation to show you where they looked.

So the requirement changes shape too. For an asset it is enough to demand a verdict with a reason. For a round you have to demand something a reason cannot fake: a location. A finding that names a file and a field proves the reader was there. A finding that says the argument is sound proves nothing at all, and reads exactly like a round that never ran.

What the Claim Is, Precisely

State it narrowly, because the strong version is indefensible. The protocol does not claim the reviewer's judgment is correct, and it does not claim their taste is good. The claim is exactly: nothing un-judged ships.

At round scale that has a specific consequence worth naming. The reviewer is allowed to be wrong about every single finding and the round still did its job, because the author then has to argue back with evidence — and arguing back is a second reading of the same material by somebody who now has a reason to look closely. A round that produces four wrong findings has still caused the artifact to be read twice. A round that produces none has caused nothing.

That the claim is weak is what makes it defensible rather than what makes it cheap. "Our reviewers have good taste" cannot be demonstrated, so the argument degenerates into a contest of taste. "Every finding in this round names a location a second reader can go and check" can be counted, and when it is not true you can point at exactly where.

Rounds Do Not Simply Go Down

A healthy sequence does not fall cleanly, and a workshop that expects it to will stop too early. Counts oscillate, because a round samples the artifact rather than sweeping it and because a repair seeds defects of its own. What a round tells you is what it named and whether a second reader could act on it — never how many things it named.

Two shapes are worth recognizing. A round whose count rises usually means the reviewer opened a drawer nobody had looked in before — a different slot, a different field, a different layer — and the spike is new coverage rather than regression. And the round that fixes the last finding is not the last round, because repairs introduce their own defects: one measured sequence, run over more rounds than the trend below, had three of its ten findings introduced by the previous round's fix, all sitting in the same file as the fix, in prose the diff shows as unchanged.

Budget one round past the last one that produced a repair. A round is evidence about the artifact as it stood when that round started, and every fix made since is by definition unreviewed — so a round closes the loop only when it accepted nothing, with every stet on the record, and nothing changed after it. Landing an artifact that differs from the one that passed is landing something nobody read.

Code

Two verdicts, and why only one of them is a review·text
# NOT A REVIEW

  verdict: pass
  notes:   "Looks good. Well structured, clear examples."

  -> could have been produced without opening the artifact, and
     is indistinguishable from a round that was not run.


# A REVIEW

  verdict: fix-first
  findings:
    1. [correctness] Section 3 says the guard runs after the call.
       Section 5's diagram shows it running before. One is wrong;
       from the surrounding argument, section 3 is.
    2. [support]     "three incidents" is asserted twice and
       enumerated once, with two entries.
    3. [scope]       The exercise asks the reader to do something
       the lesson never showed them how to do.
  observations (non-blocking):
    - the closing callout repeats the opening claim verbatim

  -> every entry names a location and a reason. a second reader
     could act on all four without asking a question.


# THE TREND ACROSS ROUNDS
  round 1: 6 blockers
  round 2: 2      <- all 6 of round 1 repaired, 2 new
  round 3: 4      <- NOT a regression: a slot nobody had audited
  round 4: 1      <- introduced by round 3's own fix
  round 5: 0 raised  <- a round that raises nothing is a FAILED
                     round, not a clean one. re-run it on
                     another reviewer. what closes the loop
                     is zero ACCEPTED, every stet on record

External links

Exercise

Take your last five completed reviews and count, per review, how many findings name a specific location — a file, a line, a field, a step — rather than describing an impression. Then count how many rounds have zero such findings. That second number is how many of your reviews cannot be distinguished from reviews that did not happen.
Hint
Do not count findings that were correct; count findings that were checkable. A wrong finding with a location is evidence somebody read the artifact, and it costs one reply to close. A right finding with no location costs an argument, and you will never know whether it came from reading or from pattern-matching the title.

Progress

Progress is local-only — sign in to sync across devices.
Spotted a bug or have feedback on this page?Report an Issue

Comments 0

🔔 Reply notifications (sign in)
Sign inPlease sign in to comment.

No comments yet — be the first.