Reverse-review documents what the junior does and gives the senior ten minutes of facilitation advice. That advice is enough for week one and runs out somewhere around week five, when the questions get harder: what makes a planted defect worth missing, why two mentors score the same card two points apart, and what it means when someone earns the same three rubric points for eight weeks running. This is the other half.
You already know whether the diff is wrong. The thing being measured is whether their confidence tracked the evidence, and that is a separate question with a separate answer.
The natural instinct in the defend phase is to compare their verdict to yours and score the distance. That instinct is why most attempts at this drift back into normal review by week five. A reviewer can arrive at your exact verdict by luck, by pattern-matching the rubric, or by having seen the diff earlier in the week, and none of those are the skill.
What you are actually watching is the relationship between two things: how sure they said they were, and how much they had. A confident catch backed by a red test and a confident catch backed by a feeling look identical on the card and are opposite results. Most of the technique on this page exists to pull those two apart.
HAD EVIDENCE HAD NONE
WAS SURE the goal the dangerous cell
praise it press hardest here, even
when the verdict is right
WAS UNSURE underclaiming honest, and normal
teach them to in weeks one to four
commit to what
they proved
The top-right cell is the one that matters, and it is the one a correctness-focused mentor never sees, because when the verdict is right there is nothing to correct. Press it anyway. A junior who is right for no reason will be wrong for no reason next month, with the same delivery.
A good planted defect is one a competent person misses for a reason. A bad one is merely hidden, and hiding things teaches nothing.
Last year's real incidents, re-planted. They are already the right shape, they already survived a real pipeline, and the debrief comes with a story about what it cost. A team that converts each postmortem into one seeded diff has a training set nobody can buy.
If two seniors score the same review differently, the rubric is measuring the mentor. Find out once a quarter, in twenty minutes.
Any team with more than one mentor has this problem and almost none of them measure it. The junior experiences it as arbitrary: the same quality of work scores three one week and one the next, depending on who was in the room. That is the fastest way to convince somebody the whole exercise is theatre.
One mentor accepts a regression test as a durable fix; another demands a lint rule or a gate. Both are defensible and the reviewer cannot read minds. The resolution is not to argue it in the abstract but to write down your team's altitude rule: which classes of defect earn a sentence in the charter, which earn a check, and which earn a gate that refuses. That document is useful far beyond this exercise.
Second most common is "proved", where the disagreement is whether a specific input plus its wrong output counts, or whether only a committed failing test does. Pick one, write it down, and stop relitigating it weekly.
One card tells you almost nothing. Twelve tell you which of six quite different coaching problems you have.
Keep a four-column sheet, one row per week: found, proved, classified, durable fix. Do not total it. The total is the least informative number on the page, and writing it down invites everyone to optimise it. What you want is which column is flat.
| Pattern over 6+ weeks | What it usually is | The move |
|---|---|---|
| Found rising, proved flat | Catching by instinct, cannot evidence it. Will fold under any pushback. | Failing test before they say a word, every week for a month. |
| Classified always earned, found often lost | Learned the vocabulary, not the search. Naming classes from memory. | Deal two clean diffs in a row. See §4. |
| Durable fix always lost | Reviewing the code, not the system. A very common ceiling. | Pair them on one charter rule. This is the on-ramp to R4. |
| All four earned by week six | Either exceptional, or your diffs are too easy. The second is more likely. | Raise difficulty once. If it holds, move to live diffs early. |
| Found rising, false positives rising | Trained to produce findings. Your clean-diff ratio is too low. | Go to one clean diff in three and say nothing about it. |
| Everything flat for eight weeks | Not a rubric problem. See §8 before concluding anything about the person. | Audit your own inputs first. |
The two flagged rows are the ones that get misread as effort problems. Both are usually produced by the mentor: the first by a diff pool that is always defective, the second by material that is too hard, too easy, or too samey to generate any signal at all.
Not cheating. Ordinary, mostly unconscious optimisation toward the thing being measured, and the reason it needs naming is that it is invisible in the score.
All four are evidence that the rubric is being taken seriously, which is better than the alternative. Name the game, apply the counter, move on. A mentor who treats optimisation as dishonesty gets a reviewer who optimises more carefully and stops telling you things.
Arguing the wrong side on purpose is the only way to find out whether a correct finding survives disagreement. It is also the fastest way to damage the whole exercise if run badly.
Roughly one review in three, push back on a finding you know is correct. Calmly, with a plausible reason, no tell. What you are measuring is whether their position is attached to evidence or to your face.
Never run this on a review of their own code, where the social cost of holding is real rather than simulated. And never run it before week eight. It requires an existing relationship to be a drill instead of an ambush, and there is no way to shortcut that.
The target failure mode is worth stating plainly, because it is what justifies the risk. An engineer who cannot find defects is early in their career. An engineer who finds them and abandons them whenever a confident person disagrees will still be doing that at eight years in, and by then nobody is checking whether they were right.
The answer to "we have six early-career engineers and one person with time." Cost per reviewer drops to about eleven minutes.
The group format is better than the one-to-one version in one specific way: hearing three peers reach three different verdicts on the same lines is a more convincing argument for humility than anything a senior can say. It is worse in one way too, which is that quiet people can hide. Rotate who presents their card first, and read the written cards rather than trusting the discussion.
Four is the working maximum. At six, the compare phase stops converging and the mentor reverts to lecturing to save time. Two groups of four beats one group of eight, even when the mentor is the same person on the same afternoon.
The exercise is supposed to end. A weekly ritual that runs forever has become furniture.
That last exit deserves defending, because it feels uncomfortable and gets skipped. A mentor who has never been graded by the person they trained has no evidence the training worked, only an impression. The swap produces evidence in one session, and if the result is embarrassing, that is a fact you needed and did not have.
Audit your own inputs before you conclude anything about the person. Three of the four common causes are on the mentor's side of the table.
"You are not improving" is unusable and lands as a verdict on character. "You have lost 'proved' eleven weeks running, we tried writing the test first and it did not move, and I do not have another idea yet" is usable, honest about your own uncertainty, and gives them something to push against.
Then distinguish three cases, because they need different responses. Not yet is the most common and deserves more time and a different approach. Cannot is rare, hard to establish, and should never be concluded from one exercise in isolation. Will not is not a mentoring problem at all: it is a management conversation about whether the person wants this job, and running more reps will not surface it any faster.
Every one of them is comfortable, defensible in the moment, and ends with the exercise becoming a code review again.
If you take one thing from this page, take the fourth tell. Spend the last two minutes of every session saying out loud what made you uneasy and why, including the times you were wrong. It is the part of your expertise that never surfaces in normal review, it costs nothing, and it is the only thing here that transfers directly.