Heuristics and biases
Heuristics and biases is a research program, most closely associated with Daniel Kahneman and Amos Tversky, that documents the systematic deviations between human judgment and the norms of rational choice. A heuristic is a cognitive shortcut — a quick, efficient rule that produces serviceable answers under normal conditions. A bias is the systematic error that results when a heuristic is applied to a situation for which it is structurally ill-suited. The framework has been enormously influential in economics, law, medicine, and policy, but it has also been the subject of a sustained and increasingly successful critique.
The program's central finding is that human judgment is not merely noisy but systematically distorted. The representativeness heuristic leads people to judge probability by how similar an event is to a prototype, neglecting base rates. The availability heuristic leads people to judge frequency by how easily examples come to mind, producing distorted risk perceptions. The anchoring heuristic leads people to over-rely on the first piece of information they receive, even when it is arbitrary. The affect heuristic leads people to conflate emotional evaluation with factual assessment. In each case, the heuristic is ecologically rational in its typical environment — the problem is the mismatch between the environment in which the heuristic evolved and the environment in which it is applied.
The Fast-and-Frugal Heuristics Critique
The most influential alternative framework is the 'fast-and-frugal heuristics' program developed by Gerd Gigerenzer and the ABC Research Group at the Max Planck Institute. Gigerenzer argues that the heuristics-and-biases program has misdiagnosed the problem. It does not demonstrate that human cognition is irrational; it demonstrates that human cognition is poorly matched to the artificial, information-lean environments of the psychology laboratory. When people are given information in ecologically valid formats — natural frequencies rather than probabilities, for example — many of the demonstrated biases disappear.
More radically, Gigerenzer argues that heuristics are not cognitive bugs but adaptive tools. The less-is-more effect demonstrates that inferences based on limited information can outperform inferences based on complete information, because the additional information introduces noise. The take-the-best heuristic ignores all but the most valid cue, yet it matches or exceeds multiple regression in predictive accuracy across a wide range of domains. This is not a claim that humans are always rational; it is a claim that rationality must be evaluated relative to the structure of the environment, not relative to an abstract norm.
Implications for Automation and Situation Awareness
The debate between the heuristics-and-biases program and the fast-and-frugal program has direct implications for the design of automated systems. If human judgment is systematically flawed, then the appropriate role of automation is to override or supplement human decision-making. This is the logic of decision support systems, checklists, and algorithmic override. If, on the other hand, human judgment is ecologically rational and sensitive to environmental structure, then the appropriate role of automation is to make that structure visible and actionable — the logic of ecological interface design and Cognitive Work Analysis.
The stakes are considerable. In aviation, medical diagnosis, and financial regulation, the choice between these two frameworks shapes whether the human is treated as a liability to be managed or a resource to be supported. The heuristics-and-biases tradition tends toward the former; the ecological tradition tends toward the latter. The evidence, on balance, suggests that both positions capture part of the truth. Human experts are capable of remarkable judgment in well-structured domains, but they are also vulnerable to predictable errors in domains that exploit their heuristics. The design question is not whether to trust the human or the algorithm, but how to structure the human–algorithm interaction so that each compensates for the other's limitations.