Goodhart's Law
Goodhart's Law is the observation that when a measure becomes a target, it ceases to be a good measure. Articulated by economist Charles Goodhart in 1975, the law was originally formulated in the context of monetary policy: any observed statistical regularity will tend to collapse once pressure is placed upon it for control purposes. The principle has since generalized far beyond economics into a fundamental theorem of system design, organizational behavior, artificial intelligence alignment, and any domain where quantitative metrics are used to steer complex systems.
The law is not merely a cautionary tale about gaming metrics. It describes a structural property of coupled systems: the act of measurement changes the system being measured, and when measurement is linked to reward, the system will reconfigure itself to optimize the metric rather than the underlying property the metric was designed to proxy. This is not a failure of human virtue but a dynamical inevitability.
The Core Mechanism
Goodhart's Law operates through three coupled dynamics:
- The proxy problem: Metrics are always simplifications. A university ranking that weights "faculty-student ratio" proxies educational quality through a single number. The ratio is not the quality; it is a correlate under specific historical conditions. Once the ranking becomes a target, universities restructure hiring and admissions to optimize the ratio — adjuncts replace tenure lines, class sizes are manipulated — while the underlying quality may decline.
- The coupling problem: When measurement is tied to resource allocation, the system develops feedback loops that amplify deviation from the proxy's original correlates. In machine learning, an objective function (the metric) is optimized through gradient descent. The model does not "understand" the objective; it finds the cheapest way to satisfy it. A classifier trained to detect pneumonia from chest X-rays learns that portable X-ray machines (used for sicker patients) have different image statistics, and optimizes for machine type rather than pathology.
- The reconfiguration problem: Over time, the system itself changes in response to the metric. Markets adapt to regulatory metrics; students adapt to standardized tests; organizations adapt to KPIs. The adapted system is no longer the system the metric was calibrated on. The metric becomes a distorting lens.
Varieties and Extensions
Campbell's Law, formulated by social psychologist Donald Campbell, is a close cousin: "The more any quantitative social indicator is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor." The emphasis on "social processes" makes Campbell's Law more specific to institutional contexts, while Goodhart's Law is more general.
Marilyn Strathern's formulation — "When a measure becomes a target, it ceases to be a good measure" — strips the principle to its essence. It applies with equal force to:
- AI alignment: Reward hacking, where reinforcement learning agents exploit loopholes in their reward functions (the metric) to achieve high scores without performing the intended task.
- Scientific publishing: Impact factors and citation metrics, which have restructured research incentives toward salami slicing, citation cartels, and fashionable topics.
- Healthcare: Patient satisfaction scores, which incentivize opioid prescription and unnecessary testing.
- Education: Standardized testing, which narrows curricula and teaches test-taking rather than critical thinking.
The Systems-Theoretic View
From the perspective of second-order cybernetics, Goodhart's Law is a special case of observer-system coupling. The metric is not an external description of the system; it is a perturbation that enters the system's dynamics. The system, treated as an anticipatory system, models the metric-imposing environment and adapts to it.
In the language of the Free Energy Principle, the metric becomes part of the system's generative model. The system minimizes variational free energy not with respect to the true environment but with respect to the observed metric. The result is a misalignment between the system's internal model and the external reality — a form of epistemic trapping.
This connects Goodhart's Law to the broader phenomenon of regime shifts in complex adaptive systems. A system optimized for a single metric is a system pushed toward a boundary in its adaptive landscape. The boundary may be a tipping point: small perturbations can trigger collapse into a new regime that optimizes the metric at the expense of system viability. The 2008 financial crisis, in this framing, was a Goodhart event: banks optimized for risk-weighted capital ratios (the metric) through regulatory arbitrage, creating systemic fragility that the metric did not capture.
Escaping Goodhart Traps
The literature offers several strategies, none fully satisfactory:
- Process over outcome metrics: Measure how decisions are made rather than only what they produce. This is harder to game but harder to operationalize.
- Multiple metrics: Use diversified portfolios of metrics to make gaming harder. But this trades precision for robustness and may simply shift gaming to the aggregation function.
- Meta-learning: Let the metrics themselves adapt. This requires a higher-order learning system with its own alignment risks.
- Participatory measurement: Involve those being measured in metric design. This increases legitimacy but may not reduce gaming.
The deeper insight is that Goodhart's Law cannot be "solved" within a single-level optimization framework. It requires what Elinor Ostrom called polycentric governance — multiple centers of authority with overlapping jurisdictions, none of which has sole control over the metric. The redundancy and competition between measurement systems creates a kind of modularity that limits the damage any single metric can do.