Collection 12

The Story vs. The Data

A single powerful story feels more convincing than a table of statistics. That is not a flaw in your character -- it is how human minds were built. For most of our history, a vivid firsthand account was the best evidence available, and our brains learned to weight it accordingly. The trouble starts when that ancient instinct meets a world full of spreadsheets, sample sizes, and publication pipelines. Stories can illuminate, but they can also crowd out the quieter, less dramatic evidence that would tell you something truer.

What to Notice

That uneasy feeling when a single vivid example is doing all the persuasive work and the broader picture has gone quiet
A growing instinct for asking not just 'is there evidence?' but 'what kind of evidence, and what got left out?'
The moment you notice a number that looks impressively precise and feel the question forming: does the measurement actually support that precision?
A deepening comfort with saying 'that is a compelling story, and I want to know what the data says before I generalize from it'

Concepts in This Collection

F082

Hasty Generalization

We see a few examples and our minds race ahead to a general rule. It is one of the most natural things we do -- pattern recognition is what got us out of the savanna. The problem is not that we generalize. It is that we often generalize long before we have seen enough to know whether the pattern is real.

1 of 5
F086

Anecdotal Evidence

We hear a single compelling story and it reshapes how we think about an entire issue. It is not that the story is false -- often it is perfectly true. The problem is that a story is an example, not a survey, and our minds have a hard time keeping that distinction in focus when the example is vivid enough.

2 of 5
F229

Generalization from Fictional Evidence

We draw on novels, movies, or thought experiments as though they tell us how the real world works. It is easy to do because fiction feels like experience -- we watched the story unfold, we followed the characters, and our brains filed it alongside real memories. But fiction was written to be interesting, not to be representative, and the patterns it teaches us are the patterns of good storytelling, not the patterns of reality.

3 of 5
F213

False Precision

We see a number with extra decimal places and it feels more trustworthy than a round one. That instinct is not wrong in principle -- precision often does signal careful measurement. But sometimes the decimal places are doing more work on our confidence than the underlying measurement can support, and the number looks more certain than it has any right to be.

4 of 5
F214

File Drawer Problem

We look at the published research and assume it shows us the full picture. But the studies that found nothing interesting -- the ones that showed no effect, no correlation, no breakthrough -- are sitting unpublished in researchers' file drawers. What we see is a highlight reel, not a representative sample, and the highlight reel systematically overstates how strong and consistent the evidence really is.

5 of 5