AI did not end the data literacy crisis. It changed it. As machines move from providing information to interpreting it and recommending what to do, the scarce skill is becoming judgment: knowing what to trust, what to question, and what decisions are still ours to make.
Evidence does not make decisions. People interpret it, weigh it, challenge it, and make judgments. A courtroom reveals what leaders can learn about evidence, expertise, confidence, and data-informed decision-making.
Feeling sure doesn't mean you're right. Learn five simple ways to question what feels true, spot what might be influencing you, and make better decisions about what to believe.
Every organization keeps one scoreboard for mistakes and none for missed opportunities. So people optimize the one they can see, and the largest losses never appear as losses at all. They appear as things no one tried.
People are remarkably rational. They optimize for the score they are given, not the outcome you actually want.
Organizations do not suppress candor and learning through culture. They suppress it through measurement. People are rational: they optimize for the score they are given, not the outcome you actually want. And the score almost everyone is kept on rewards one thing above all, the avoidance of visible error. So people avoid it, along with the risk-taking that produces every good decision.
You have watched a capable person hedge a forecast, sit on a dissent, or pass on an experiment that would have worked. The instinct is to ask for more courage. That is the wrong lever, because it asks individuals to fight a system still scoring them the old way. Every organization keeps a scoreboard for mistakes and none for missed opportunities, so the largest losses never appear as losses. They appear as things no one tried. Change what gets measured and reviewed, and the behavior changes without anyone needing to be brave.
Anyone who sets the questions in a review, designs a metric, or evaluates a call under uncertainty. The leader whose forecasts have quietly gone conservative. The manager whose team stopped surfacing bad news early. Anyone running an AI pilot that stalled because one visible error outweighed a hundred quiet wins, and anyone who suspects their smartest people have started playing it safe.
A way to see the second scoreboard your organization never built, and four concrete changes to your instruments: scoring forecasts against difficulty, separating decision quality from outcome quality, asking directly for the calls people chose not to make, and making "what would have changed our minds" a standing question. Plus an honest line for where this argument stops, because in a few settings punishing visible error is exactly right.
A manager sits in a forecasting meeting with a number she does not believe. Her model says the quarter will land twelve percent below plan. The room expects a number close to plan. She has been here before. If she says twelve percent and she is wrong, that miss has her name on it, in a deck, in front of people who will remember. If she says something closer to plan and she is wrong, she is wrong alongside everyone else, which is a much safer place to be wrong.
So she shades the number up. Not by much. Just enough to be defensible.
She is not a coward. She is doing exactly what a rational person does when they understand how the score is kept. The organization will tell you, sincerely, that it values candor and wants its people to surface hard truths early. And it means it. But sincerity is not the thing shaping her behavior. The scoreboard is. And the scoreboard rewards being defensibly wrong over being visibly, accurately, uncomfortably right.
This is not a story about fear, or culture, or psychological safety, though it touches all three. It is a story about measurement. And once you see it that way, it stops being a soft problem you fix with encouragement and becomes a design problem you can actually solve.
People are remarkably rational. They optimize for the score they are given, not the outcome the organization actually wants.
That is not cynicism. It is close to a law. It has been observed so many times, in so many fields, that it has two names. Donald Campbell put it one way in the 1970s: the more any quantitative indicator is used for decision-making, the more it distorts the process it was meant to measure. Charles Goodhart put it another way that got shortened into the version everyone quotes: when a measure becomes a target, it stops being a good measure. Neither man was describing cheating. They were describing what honest people do when you tell them what counts.
Once you stop looking for villains, the pattern is everywhere.
A support team measured on tickets closed will close tickets that are not resolved. A sales team measured on quarterly quota will pull deals forward and sandbag the next quarter. A teacher measured on test scores will teach the test. A hospital measured on the wrong quality indicator can improve the indicator while the care underneath it gets worse. None of these people woke up wanting to do the wrong thing. Each of them read the scoreboard correctly and responded to it.
This ends the free preview.
Create a free account to get full access. No payment required.
Sign up for free
Evidence does not make decisions. People interpret it, weigh it, challenge it, and make judgments. A courtroom reveals what leaders can learn about evidence, expertise, confidence, and data-informed decision-making.
Feeling sure doesn't mean you're right. Learn five simple ways to question what feels true, spot what might be influencing you, and make better decisions about what to believe.
We teach data literacy as a ladder: data at the bottom, wisdom at the top, climb step by step. But the rungs are not where the work happens. The judgment lives in the gaps between them, and that is exactly where AI now carries us straight past.
What a historic Red Sox winning streak reveals about the Two Clocks of decision-making. Every important decision is made between the deadline to act and the time required for evidence to mature. That's where judgment matters most.
