The Asymmetry That Makes Review Work
Here is the finding that keeps surprising people, including the people it keeps surprising: the same system will convict in review mode what it could not prevent in authoring mode. Hand it a draft it produced an hour ago, in a fresh context, with the instruction to find what is wrong, and it finds real defects — including the exact ones it just wrote.
That is not a paradox and it is not a sign of unreliability. Writing and judging are different operations with different inputs. Writing is generative and conditions on everything in the room, including the source you were told not to lean on. Judging conditions on the artifact and asks a different question. Same capability, different mode, genuinely different results.
Why This Matters for What You Build
If detection were as unreliable as generation, the whole design would collapse — there would be no point separating author from reviewer, because the reviewer would reproduce the author's blindness. The design works because that is false. The variable is not capability, it is contamination: a fresh context flagging several samples is trustworthy on its own, and a second reader does not measure anything the first one missed for reasons of context.
This settles what not to build, which is more valuable than what to build. No consensus panels. No averaging of two reviewers. No inter-rater reliability coefficient. Those instruments exist to quantify uncertainty about judges, and the uncertainty here is about context — a second judge does not measure it. A single reading from an uncontaminated reader is a result, not a provisional finding awaiting confirmation.
The Engineering Goes Into the Seal
Once you accept that reading is the reliable half, the place to spend engineering effort becomes obvious: make sure the reader is actually uncontaminated. That is what the whole third track was about. Everything spent on cross-validating readers against each other would be spent measuring the wrong variable.
And it is worth noticing that the instinct runs the other way. The first reaction to a set of surprising scores is to doubt the scorer and reach for a second opinion. That instinct imports a methodology whose premise does not hold here, and following it costs a second full pass to learn nothing.