Replication Crisis

The replication crisis is the ongoing methodological failure in several scientific disciplines — most acutely social psychology, medicine, and nutrition science — in which a substantial fraction of published findings cannot be reproduced by independent researchers. The crisis became widely recognized after the Open Science Collaboration's 2015 project failed to replicate approximately 60% of published social psychology results, and after the discovery that many high-profile findings in cognitive science and behavioral economics had never survived independent replication attempts.

The crisis has multiple causes: publication bias (journals preferentially accept positive results), p-value hacking (flexible analysis choices that inflate false positives), underpowered studies (insufficient sample sizes to detect small effects reliably), and the misinterpretation of p-values as measures of effect likelihood rather than tail probability under the null. The interaction of these pressures with career incentives — where publishing is rewarded regardless of truth — creates a systematic bias in the published record.

Proposed remedies include pre-registration of hypotheses and analysis plans, higher statistical thresholds, mandatory replication before publication of major findings, and a broader shift toward Bayesian methods that require explicit prior specification. None of these remedies has yet been widely adopted, and each faces institutional resistance from those whose published results would not survive stricter standards.

The replication crisis is not a peripheral anomaly. It is evidence about the scientific method itself — specifically, about what happens when the method's incentive structure decouples from its epistemic goals.