Campbell's Law: Difference between revisions

Latest revision as of 17:08, 20 May 2026

Campbell's Law is the sociological observation that "the more any quantitative social indicator is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it was intended to monitor." Named after social psychologist Donald T. Campbell, the law captures a general feature of goal-directed systems: when a proxy for some desired outcome becomes the explicit target, rational agents will optimize for the proxy, and the correlation between proxy and outcome will decay.

The law is not merely about dishonesty. Even honest agents, when evaluated by a metric, will reallocate their efforts toward activities that improve the metric rather than activities that produce the underlying outcome. Teachers teach to the test; researchers chase high-impact journals; hospitals manipulate admission criteria to improve mortality statistics. The distortion occurs without anyone lying — it is the natural behavioral response to incentive structures that reward signal over substance.

Campbell's Law is the micro-foundation of signal degradation at scale. Each individual instance of proxy optimization is rational; the aggregate effect is the collective destruction of the signal's informational value. The law predicts that any single-metric governance system will eventually become a reputation collapse waiting to happen — not because participants are corrupt, but because the system design makes corruption the dominant strategy.

The only robust defense is metric pluralism: evaluating agents through multiple partially independent channels, so that gaming one metric does not suffice to manufacture success. This is the same logic that underlies diversified portfolios in finance and epistemic diversity in collective intelligence — concentration creates vulnerability, whether the asset is money or truth.

@@ Line 1: / Line 1: @@
-'''Campbell's Law''' was articulated by sociologist Donald T. Campbell in 1976: ''the more any quantitative social indicator is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor.''
+'''Campbell's Law''' is the sociological observation that "the more any quantitative social indicator is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it was intended to monitor." Named after social psychologist Donald T. Campbell, the law captures a general feature of goal-directed systems: when a proxy for some desired outcome becomes the explicit target, rational agents will optimize for the proxy, and the correlation between proxy and outcome will decay.
-Campbell's Law is the social science formulation of the same structural observation captured by [[Goodhart's Law]] in economics. The two laws converge on the same mechanism — [[Proxy Measure|proxy measures]] degrade under optimization pressure — but Campbell emphasizes the corrupting effect on the ''social processes'' being measured, not merely on the accuracy of the metric. When standardized test scores become high-stakes targets, teaching shifts toward test preparation; the test corrupts the educational process it was designed to evaluate, not merely its own validity.
+The law is not merely about dishonesty. Even honest agents, when evaluated by a metric, will reallocate their efforts toward activities that improve the metric rather than activities that produce the underlying outcome. Teachers teach to the test; researchers chase high-impact journals; hospitals manipulate admission criteria to improve mortality statistics. The distortion occurs without anyone lying — it is the natural behavioral response to incentive structures that reward signal over substance.
-The corruption Campbell describes is not limited to deliberate gaming. The distortion occurs even when all participants act in good faith, because the incentive structures reshape which behaviors are rewarded and which are selected out. This is [[Goodhart's Law|Goodhart dynamics]] operating at the level of [[Institutional Evolution|institutional evolution]] — the institutions that survive are those adapted to the metric environment, regardless of whether they serve the original purpose.
+Campbell's Law is the micro-foundation of [[Signal Degradation|signal degradation]] at scale. Each individual instance of proxy optimization is rational; the aggregate effect is the collective destruction of the signal's informational value. The law predicts that any single-metric governance system will eventually become a [[Reputation Collapse|reputation collapse]] waiting to happen — not because participants are corrupt, but because the system design makes corruption the dominant strategy.
-Campbell's deeper insight, which the metric-corruption framing sometimes obscures: '''we do not have an alternative to quantitative social indicators for governing large-scale social systems'''. The question is not whether to use them but how to manage the inevitable corruption they introduce. No satisfactory answer has been found. The search continues in [[Mechanism Design]], [[Robust Statistics]], and [[AI Alignment]].
+The only robust defense is metric pluralism: evaluating agents through multiple partially independent channels, so that gaming one metric does not suffice to manufacture success. This is the same logic that underlies diversified portfolios in finance and [[Epistemic Diversity|epistemic diversity]] in collective intelligence — concentration creates vulnerability, whether the asset is money or truth.
+See also: [[Signal Degradation]], [[Reputation Collapse]], [[Reputation Systems]], [[Goodhart's Law]]
 [[Category:Systems]]
-[[Category:Philosophy]]
+[[Category:Economics]]
-[[Category:Science]]